JP6036621B2 - System, information processing device - Google Patents

Description

  The present invention relates to a system in which a plurality of information processing apparatuses that share an image displayed on a display unit are connected via a network.

  An electronic blackboard is used in which a background image is displayed on a large display at a meeting in a company, an educational institution, an administrative organization, etc., and a user can draw stroke images such as letters, numbers, and figures on the background image. . In such an electronic blackboard, a stroke image generated by the user can be displayed on a large display or the like. In addition to displaying the stroke image, the user can edit the displayed image and save the image.

  In addition, with the spread of networks, a technology is also known in which electronic blackboards at each base are connected by a network so that each electronic blackboard shares a stroke image or the like (see, for example, Patent Document 1). Patent Document 1 discloses a mutual information sharing system that transmits base identification information together with input data, and displays the data by attaching base information such as an operator.

  However, in such a system using an electronic blackboard, there is a problem that a security inconvenience may occur. That is, even if the stroke image shared with the electronic blackboard at another base contains confidential information, all participants in the conference can freely edit and save the stroke image. For this reason, the participant can transmit the stroke image to the outside or record it on a memory card and take it out without the owner of the stroke image being aware.

  In view of the above problems, an object of the present invention is to provide a system or the like that can restrict operations on images shared by each base.

In order to solve the above problems, the present invention is a system in which a plurality of information processing devices connected via a network communicate with each other, and the information processing device is an operation that restricts other information processing devices from receiving operations A limit accepting unit that accepts a restriction setting; and a transmission unit that transmits information based on the operation restriction setting to the other information processing apparatus, and the limit accepting unit is connected to the other information processing apparatus. Receiving a restriction on a storage operation for saving the image displayed on the displayed display means, an editing operation for editing the image displayed on the display means, or a display operation for displaying the image on the other information processing apparatus. Thus, the restriction of a plurality of operations classified as the save operation, a plurality of operations classified as the editing operation, or a plurality of operations classified as the display operation is collectively accepted. It is those,
The other information processing apparatus is configured to restrict the acceptance of an operation by an operation accepting unit of the other information processing apparatus based on information based on the operation restriction setting.

  It is possible to provide a system or the like that can restrict operations on images shared by each base.

1 is an example of an overall configuration diagram of an image processing system. It is an example of the hardware block diagram of an electronic blackboard. It is an example of the functional block diagram of an electronic blackboard. It is an example of a functional block diagram of a file processing unit. It is an example of the functional block diagram of a communication control part. It is an example of the figure which illustrates page data typically. It is an example of the figure which illustrates stroke sequence data typically. It is an example of the figure which illustrates coordinate arrangement data typically. It is an example of the figure which illustrates media data typically. It is an example of the figure which illustrates a remote license management table typically. It is an example of the figure which illustrates an address book management table typically. It is an example of the figure which illustrates backup data typically. It is an example of the figure which illustrates a connecting point management table typically. It is an example of the figure which illustrates a participating base management table typically. It is an example of the figure which illustrates operation data typically. It is an example of the figure which illustrates typically the function restriction list memorized by the function restriction management part. It is a figure which shows an example of the creation screen of a function restriction list. It is a figure which shows an example of the creation screen of a function restriction list. It is a figure which shows an example of the creation screen of a function restriction list. It is an example of the figure explaining the superimposition process of each image layer. An example of a sequence diagram in which an electronic blackboard holds a remote conference with function restrictions is shown. A process for the electronic blackboard to participate in the remote sharing process will be described. It is an example of the figure explaining the process of the operation data in a remote sharing process. It is a figure which shows an example of UI image displayed on a display. It is an example of the figure explaining the response | compatibility of the function when a user selects each icon, and a function restriction | limiting. It is an example of the figure explaining the response | compatibility of the function when a user selects each icon, and a function restriction | limiting. (Example 2) which is a figure which shows an example of the production | generation screen of a function restriction list. (Example 2) which is an example of the figure which illustrates the function restriction list of a function restriction management part typically. (Example 3) which shows an example of the production | generation screen of a function restriction list. (Example 3) which is an example of the figure which illustrates the function restriction list of a function restriction management part typically.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<System overview>
FIG. 1 is an overall configuration diagram of an image processing system according to the present embodiment. In FIG. 1, only two electronic blackboards 2a and 2b and associated electronic pens 4a and 4b are shown to simplify the description. A pen or the like may be used. The electronic blackboards 2a and 2b are examples of the information processing apparatus in the claims.

As shown in FIG. 1, the image processing system 1 includes a plurality of electronic blackboards 2a and 2b, a plurality of electronic pens 4a and 4b, USB memories 5a and 5b, notebook PCs (Personal Computers) 6a and 6b, a television ( Video) having conference terminals 7a, 7b and PC8. The electronic blackboards 2a and 2b and the PC 8 are connected via a communication network 9 so that they can communicate with each other. Further, the plurality of electronic blackboards 2a and 2b are respectively provided with displays 3a and 3b. Also, the electronic blackboard 2a has an event generated by the electronic pen 4a (the pen tip of the electronic pen 4a on the display 3a or An image drawn by touching the pen butt of the electronic pen 4a can be displayed on the display 3a. Note that the image displayed on the display 3a can be changed based not only on the electronic pen 4a but also on an event (a gesture such as enlargement, reduction, or page turning) generated by the user's hand Ha or the like. The electronic pen 4 and the hand H are examples of the pointing device in the claims.

  The electronic blackboard 2a can be connected to a USB memory 5a. The electronic blackboard 2a can read an electronic file such as PDF from the USB memory 5a, and the electronic blackboard 2a can record the electronic file in the USB memory 5a. . In addition, the electronic blackboard 2a is connected via a cable 10a1 capable of communication according to standards such as DisplayPort, DVI (Digital Visual Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), and VGA (Video Graphics Array). A notebook PC 6a is connected. The electronic blackboard 2a generates an event by touching the display 3a, and transmits event information indicating the event to the notebook PC 6a in the same manner as an event from an input device such as a mouse or a keyboard. Similarly, a television (video) conference terminal 7a is connected to the electronic blackboard 2a via a cable 10a2 capable of communication according to the above-mentioned standards. Note that the notebook PC 6a and the video conference terminal 7a may communicate with the electronic blackboard 2a by wireless communication complying with various wireless communication protocols such as Bluetooth (registered trademark).

  On the other hand, in the other bases where the electronic blackboard 2b is installed, the electronic blackboard 2b with the display 3b, the electronic pen 4b, the USB memory 5b, the notebook PC 6b, the video conference terminal 7b, the cable 10b1, and the cable 10b2 in the same manner as described above. Is used. Furthermore, the image displayed on the display 3b can be changed based on an event caused by the user's hand Hb or the like.

  Thereby, the image drawn on the display 3a of the electronic blackboard 2a at one base is also displayed on the display 3b of the electronic blackboard 2b at another base, and conversely on the display 3b of the electronic blackboard 2b at another base. The image drawn on is displayed on the display 3a of the electronic blackboard 2a at one base. As described above, the image processing system 1 can perform remote sharing processing for sharing the same image at a remote location, and thus is very convenient when used for a conference or the like at a remote location.

  In the following, when an arbitrary electronic blackboard among the plurality of electronic blackboards is indicated, it is indicated as “electronic blackboard 2”. When an arbitrary display among a plurality of displays is shown, “display 3” is shown. When an arbitrary electronic pen among a plurality of electronic pens is indicated, it is indicated as “electronic pen 4”. When an arbitrary USB memory is indicated among the plurality of USB memories, it is indicated as “USB memory 5”. When an arbitrary notebook PC is indicated among the plurality of notebook PCs, it is indicated as “node PC 6”. When an arbitrary video conference terminal is indicated among the plurality of video conference terminals, it is indicated as “video conference terminal 7”. In addition, “hand H” is used when an arbitrary hand among the hands of a plurality of users is shown. When an arbitrary cable is indicated among the plurality of cables, it is indicated as “cable 10”.

  In the present embodiment, an electronic blackboard is described as an example of an image processing device. However, the present invention is not limited to this, and other examples of the image processing device include electronic signboards (digital signage), sports and weather forecasts. It may be a telestrator to be used, a remote image (video) diagnostic device, or the like. The notebook PC 6 will be described as an example of the information processing terminal, but is not limited thereto, and other examples of the information processing terminal include a desktop PC, a tablet PC, a smartphone, a PDA, a digital video camera, and a digital camera. A terminal capable of supplying image frames such as a game machine may be used. Further, the communication network includes the Internet, a LAN (Local Area Network), a mobile phone communication network, and the like. In this embodiment, a USB memory is described as an example of a recording medium. However, the present invention is not limited to this, and various recording media such as an SD card may be used as another example of the recording medium.

<Hardware configuration of electronic blackboard>
Next, the hardware configuration of the electronic blackboard according to the present embodiment will be described with reference to FIG. FIG. 2 is a hardware configuration diagram of the electronic blackboard.

  As shown in FIG. 2, the electronic blackboard 2 includes a CPU 101 that controls the operation of the electronic blackboard 2 as a whole, a ROM 102 that stores a program used to drive the CPU 101 such as an IPL, and a RAM 103 that is used as a work area of the CPU 101. And an SSD 204 for storing various data such as a program for the electronic blackboard 2, a network controller 105 for controlling communication with the communication network 9, and an external storage controller 106 for controlling communication with the USB memory 5.

  The electronic blackboard 2 also includes a capture device 111 that captures still images or moving images displayed on the display of the notebook PC 6, a GPU (Graphics Processing Unit) 112 that specializes in graphics, and an output image from the GPU on the display 3 or A display controller 113 that controls and manages screen display for output to the video conference terminal 7 is provided.

  The electronic blackboard 2 further includes a sensor controller 114 that controls processing of the contact sensor 115 and a contact sensor 115 that detects that the electronic pen 4 or the hand H of the user touches the display 3. The contact sensor 115 performs coordinate input and coordinate detection by an infrared ray blocking method. In this coordinate input and coordinate detection method, two light emitting / receiving devices (not shown) installed at both upper ends of the display 3 emit a plurality of infrared rays in parallel with the display 3, This is a method of receiving light that is reflected by the reflecting member provided on the light source and returns on the same optical path as the light path of the light emitted by the light receiving element. The contact sensor 115 outputs infrared ID (Identification) emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 114, and the sensor controller 114 identifies the coordinate position that is the contact position of the object. All IDs shown below are examples of identification information.

  In addition, the contact sensor 115 is not limited to the infrared blocking method, and a capacitive touch panel that identifies a contact position by detecting a change in capacitance, or a contact position determined by a voltage change between two opposing resistance films. Various detection means such as a resistance film type touch panel to be identified and an electromagnetic induction type touch panel to identify a contact position by detecting electromagnetic induction caused by contact of a contact object with the display unit may be used.

  The electronic blackboard 2 includes an electronic pen controller 116. This electronic pen controller 116 communicates with the electronic pen 4 to determine whether or not there is a pen tip touch or a pen butt touch on the display 3. It should be noted that the electronic pen controller 116 may determine whether or not the user grips the part of the electronic pen 4 as well as the other electronic pen part, as well as the pen tip and the bottom of the electronic pen 4.

  Further, the electronic blackboard 2 includes the CPU 101, ROM 102, RAM 103, SSD 104, network controller 105, external storage controller 106, capture device 111, GPU 112, sensor controller 114, and electronic pen controller 116 as shown in FIG. A bus line 120 such as an address bus or a data bus for connection is provided.

  The program for the electronic blackboard 2 may be recorded and distributed on a computer-readable recording medium such as a CD-ROM.

<Functional configuration of electronic blackboard>
Next, the functional configuration of the electronic blackboard will be described with reference to FIGS. First, the overall functional configuration of the electronic blackboard 2 will be described with reference to FIG. FIG. 3 is a functional block diagram of the electronic blackboard.

  The electronic blackboard 2 has the functional configurations shown in FIG. 3 by the hardware configuration and program shown in FIG. The electronic blackboard 2 can be a “host device” that starts the remote sharing process first, and can also be a “participating device” that participates in the remote sharing process that has already started. The electronic blackboard 2 includes a client machine 20 and a server machine 90 as main functions. That is, the client machine 20 and the server machine 90 are included in one casing of the electronic blackboard 2. The client unit 20 and the server unit 90 are functions realized in one housing of the electronic blackboard 2. When the electronic blackboard 2 is a hosting device, the electronic blackboard 2 implements the client unit 20 and the server unit 90. Further, when the electronic blackboard 2 is a participating device, in the electronic blackboard 2, the client unit 20 is realized, but the server unit 90 is not realized. That is, in FIG. 1, when the electronic blackboard 2a is the hosting device and the electronic blackboard 2b is the participating device, the client unit 20 of the electronic blackboard 2a receives the other via the server unit 90 realized in the same electronic blackboard 2a. Communicate with the client unit 20 of the electronic blackboard 2b. On the other hand, the client unit 20 of the electronic blackboard 2b communicates with the client units of the other electronic blackboard 2a via the server unit 90 realized in the other electronic blackboard 2a.

[Functional configuration of client machine 20]
Subsequently, the functional configuration of the client machine 20 will be described mainly using FIGS. 3 to 5. The client machine 20 includes a video acquisition unit 21, a coordinate detection unit 22, an automatic adjustment unit 23, a contact detection unit 24, an event distribution unit 25, an operation processing unit 26, a gesture processing unit 27, a video superimposition unit 28, and an image processing unit 30. And a communication control unit 60.

  Among these, the video acquisition unit 21 acquires an output video of a video output device such as a notebook PC 6 connected to the cable 10. When the video acquisition unit 21 receives an image signal from a video output device (such as a notebook PC 6), the video acquisition unit 21 analyzes the image signal, and the resolution of an image frame that is a display image of the video output device formed by the image signal, Image information such as the update frequency of the image frame is derived and output to the image acquisition unit 31.

  The coordinate detection unit 22 detects the coordinate position of an event (such as an operation in which the user's hand H is touched on the display 3) generated by the user on the display 3. The coordinate detection unit 22 also detects the touched area.

  The automatic adjustment unit 23 is activated when the electronic blackboard 2 is activated, and adjusts the image processing parameters of the sensor camera in the optical sensor method of the contact sensor 115 so that the contact sensor 115 can output an appropriate value to the coordinate detection unit 22. To do.

  The contact detection unit 24 detects an event (such as an operation in which the pen tip of the electronic pen 4 or the pen tip of the electronic pen 3 is pressed (touched) on the display 3).

  The event distribution unit 25 distributes the coordinate position of the event detected by the coordinate detection unit 22 and the detection result detected by the contact detection unit 24 to each event of stroke drawing, UI operation, and gesture operation.

  Here, “stroke drawing” is performed when the user presses the electronic pen 4 on the display 3 when a stroke image (B) described later shown in FIG. 20 is displayed on the display 3. In this state, the electronic pen 4 is moved and finally the electronic pen 4 is released from the display 3. By this stroke drawing, for example, alphabets “S” and “T” are drawn on the display 3. The “stroke drawing” includes not only drawing an image but also an event of deleting an already drawn image or editing a drawn image.

  The “UI operation” is an event in which the user presses a predetermined position with the electronic pen 4 or the hand H when a UI image (A) described later shown in FIG. 20 is displayed on the display 3. . By this UI operation, for example, the color or width of a line drawn by the electronic pen 4 is set.

  “Gesture operation” is an event in which the user touches or moves the display 3 with the hand H when a stroke image (B) described later shown in FIG. 20 is displayed on the display 3. By this gesture operation, for example, by moving the hand H while the user touches the display 3 with the hand H, the image can be enlarged (or reduced), the display area can be changed, or the page can be switched. it can.

  The operation processing unit 26 executes various operations according to the UI element in which the event is generated, from what is determined as the UI operation by the event distribution unit 25. Examples of the UI element include a button, a list, a check box, and a text box. The gesture processing unit 27 performs an operation corresponding to what is determined as a gesture operation by the event distribution unit 25.

  The restriction receiving unit 261 included in the operation processing unit 26 receives, for example, a user operation on the function restriction list creation screen illustrated in FIG. 17 and creates a function restriction list. For example, the UI image generation unit 33 displays the function restriction list creation screen.

  The video superimposing unit 28 displays the image superimposed by the display superimposing unit 36 described later as a video on the video output device (display 3 or the like). In addition, the video superimposing unit 28 performs picture-in-picture of the video sent from another video output device (such as the video conference terminal 7) with respect to the video from the video output device (such as the notebook PC 6). Further, the video superimposing unit 28 performs switching for displaying the video that is picture-in-picture and displayed on a part of the display 3 on the entire display 3.

  The image processing unit 30 performs superimposition processing of each image layer. Details will be described with reference to FIG. The image processing unit 30 includes an image acquisition unit 31, a stroke processing unit 32, a UI image generation unit 33, a background generation unit 34, a layout management unit 35, a display superimposition unit 36, a page processing unit 37, a file processing unit 40, and page data storage. Section 300 and a remote license management table 310.

  Among these, the image acquisition unit 31 acquires each frame as an image from the video acquired by the video acquisition unit 21. This image corresponds to an output image (C) from the video output device (notebook PC 6 or the like) shown in FIG.

  The stroke processing unit 32 draws an image, deletes the drawn image, or edits the drawn image based on the event related to the stroke drawing assigned by the event distribution unit 25. The image by this stroke drawing corresponds to the stroke image (B) shown in FIG. In addition, the results of drawing, deleting, and editing an image based on the stroke and the like are stored in the operation data storage unit 840 as operation data described later.

  The UI image generation unit 33 generates a UI (user interface) image set in advance on the electronic blackboard 2. This UI image corresponds to the UI image (A) shown in FIG.

  The operation restriction unit 331 included in the UI image generation unit 33 creates a UI image whose operation is restricted according to the operation restriction list. The restriction of the operation means that an icon corresponding to the restricted operation is not displayed or cannot be selected even if displayed.

  The background generation unit 34 receives media data from the page data read from the page data storage unit 300 by the page processing unit 37 from the page processing unit 37. The background generation unit 34 outputs the received media data to the display superimposing unit 36. The image based on the media data corresponds to the background image (D) shown in FIG. The pattern of the background image (D) is plain or grid display.

  The layout management unit 35 provides layout information indicating the layout of each image output from the image acquisition unit 31, the stroke processing unit 32, and the UI image generation unit 33 (or the background generation unit 34) to the display superimposing unit 36. I manage. Thereby, the layout management unit 35 causes the display superimposing unit 36 to display the output image (C) and the stroke image (B) in the UI image (A) and the background image (D). It is possible to instruct whether to hide.

  The display superimposing unit 36 performs layout of each image output from the image acquisition unit 31, the stroke processing unit 32, the UI image generation unit 33, and the background generation unit 34 based on the layout information output from the layout management unit 35. .

The page processing unit 37 stores the data of the stroke image (B) and the data of the output image (C) in one page data and stores them in the page data storage unit 300. The data of the stroke image (B) forms part of page data as stroke arrangement data (each stroke data) indicated by the stroke arrangement data ID shown in FIG. The data of the output image (C) forms part of the page data as the media data indicated by the media data ID shown in FIG. Then, when this media data is read from the page data storage unit 300, it is handled as data of the background image (D).
Further, the page processing unit 37 transmits the media data of the once stored page data to the display superimposing unit 36 via the background generating unit 34 so that the video superimposing unit 28 displays the background image (D). 3 can be displayed again. The page processing unit 37 can return the stroke arrangement data (each stroke data) in the page data to the stroke processing unit 32 so that the stroke can be re-edited. Further, the page processing unit 37 can delete or duplicate page data.
That is, the data of the output image (C) displayed on the display 3 when the page processing unit 37 stores the page data in the page data storage unit 300 is temporarily stored in the page data storage unit 300 and then When read from the page data storage unit 300, it is read as media data indicating the background image (D). Then, the page processing unit 37 outputs stroke arrangement data indicating the stroke image (B) among the page data read from the page data storage unit 300 to the stroke processing unit 32. Further, the page processing unit 37 outputs media data indicating the background image (D) among the page data read from the page data storage unit 300 to the background generation unit 34.

  The display superimposing unit 36 includes an output image (C) from the image acquisition unit 31, a stroke image (B) from the stroke processing unit 32, a UI image (A) from the UI image generation unit 33, and a background generation unit 34. The background image (D) is superimposed according to the layout designated by the layout management unit 35. Accordingly, as shown in FIG. 20, each of the UI image (A), the stroke image (B), the output image (C), and the background image (D) is displayed in the order in which the user can see even if the images overlap. It has Leia composition.

  Further, the display superimposing unit 36 can also superimpose the image (A) and the image (B) exclusively by switching the image (C) and the image (D) shown in FIG. For example, when the cable 10 between the electronic blackboard 2 and the video output device (notebook PC 6 or the like) is disconnected while the image (A), the image (B), and the image (C) are initially displayed. The drawing (C) can be removed from the superimposition target as specified by the layout management unit 35. The display superimposing unit 36 also performs display enlargement, display reduction, and display area movement processing.

  The page data storage unit 300 stores page data as shown in FIG. FIG. 6 is a conceptual diagram showing page data. The page data is data for one page (stroke data and image data) displayed on the display 3. Since there are many types of parameters included in the page data, the contents of the page data will be described here separately in FIGS.

The page data storage unit 300 stores page data as shown in FIG. FIG. 6 is a conceptual diagram showing page data. The page data is data for one page displayed on the display 3 (stroke arrangement data (each stroke data) and media data). Since there are many types of parameters included in the page data, the contents of the page data will be described here separately in FIGS.
As shown in FIG. 6, the page data includes a page data ID for identifying an arbitrary page, a disclosure time indicating the start time of display of this page, and rewriting of the contents of the page by a stroke, a gesture, or the like. Are associated with the end time indicating the time when the operation is stopped, the stroke arrangement data ID for identifying the stroke arrangement data generated by the stroke of the electronic pen 4 or the user's hand H, and the media data ID for identifying the media data. Is remembered. The stroke arrangement data is data for displaying a stroke image (B) shown in FIG. The media data is data for displaying a background image (D) shown in 16 described later on the display 3.

  With such page data, for example, when the user draws the alphabet “S” with the electronic pen 4, the stroke is written in one stroke, and therefore, one stroke data ID is displayed and one letter of the alphabet [S] is indicated. However, when the user draws the alphabet “T” with the electronic pen 4, it is written with two strokes, so that one stroke of the alphabet “T” is indicated by two stroke data IDs.

  The stroke arrangement data shows detailed information as shown in FIG. FIG. 7 is a conceptual diagram showing stroke arrangement data. As shown in FIG. 7, one stroke arrangement data is represented by a plurality of stroke data. One stroke data includes a stroke data ID for identifying the stroke data, a start time indicating the start time of writing one stroke, an end time indicating the end time of writing one stroke, the color of the stroke, A stroke width and coordinate array data ID for identifying an array of stroke passing points are shown.

  Further, the coordinate array data shows detailed information as shown in FIG. FIG. 8 is a conceptual diagram showing coordinate array data. As shown in FIG. 8, the coordinate array data includes one point (X coordinate value, Y coordinate value) on the display 3, and a time difference (ms from the disclosure time of the stroke when the one point is passed) ) And writing pressure information of the electronic pen 4 at this one point.

  That is, the collection of one point shown in FIG. 8 is shown by one coordinate array data shown in FIG. For example, when the user draws the alphabet “S” with the electronic pen 4, it is drawn with a single stroke, but passes through a plurality of passing points before the drawing of “S”. Point information is shown.

  Further, the media data in the page data shown in FIG. 6 shows detailed information as shown in FIG. FIG. 9 is a conceptual diagram showing media data. As shown in FIG. 9, the media data is stored in the page data storage unit 300 from the page processing unit 37, the media data ID in the page data shown in FIG. The recording time, the position of the image displayed on the display 3 by the page data (X coordinate value, Y coordinate value), the size of the image (width, height), and data indicating the contents of the media data are shown in association with each other. Has been. Among these, the position of the image displayed on the display 3 by the page data is displayed by the page data when the coordinates of the upper left corner of the display 3 are (X coordinate value, Y coordinate value) = (0, 0). The position of the upper left corner of the image to be displayed is shown.

  Returning to FIG. 3, the remote license management table 310 manages license data necessary for executing the remote sharing process. In the remote license management table 310, as shown in FIG. 10, the product ID of the electronic blackboard 2, the license ID used for authentication, and the expiration date of the license are managed in association with each other.

(Functional configuration of the file processing unit 40)
Next, the functional configuration of the file processing unit 40 shown in FIG. 3 will be described with reference to FIG. FIG. 4 is a functional block diagram of the file processing unit. Hereinafter, the electronic blackboard 2 that starts the remote sharing process first will be referred to as “host device”, and the electronic blackboard 2 that will participate in the remote sharing processing that has already been started will be referred to as “participating device”.

  The file processing unit 40 includes a recovery processing unit 41, a file input unit 42a, a file output unit 42b, a file conversion unit 43, a file transmission unit 44, an address book input unit 45, a backup processing unit 46, a backup output unit 47, and a setting management unit. 48, a setting file input unit 49a, and a setting file output unit 49b. Furthermore, the file processing unit 40 includes an address book management table 410, a backup data storage unit 420, a setting file storage unit 430, and a connection destination management table 440.

  Among these, the recovery processing unit 41 detects the abnormal end after the electronic blackboard 2 ends abnormally, and recovers the unsaved page data. For example, in the case of a normal end, the page data is recorded as a PDF file on the USB 5 via the file processing unit 40, but in the case of an abnormal end such as when the power is down, the page data is recorded in the page data storage unit 300. Has been done. Therefore, when the power is turned on again, the recovery processing unit 41 recovers by reading the page data from the page data storage unit 300.

  The file input unit 42a reads a PDF file from the USB memory 5 and stores each page in the page data storage unit 300 as page data. The file conversion unit 43 converts the page data stored in the page data storage unit 300 into a PDF format file.

  The file output unit 42 b records the PDF file output by the file conversion unit 43 in the USB memory 5. The file transmission unit 44 transmits the PDF file generated by the file conversion unit 43 by attaching it to an electronic mail.

  The transmission destination of the file is displayed by displaying the contents of the address book management table 410 on the display 3 by the display superimposing unit 36, and the file transmitting unit 44 accepts the selection of the destination by the operation of the input device such as a touch panel by the user. It is determined. In the address book management table 410, as shown in FIG. 11, the name of the destination and the mail address of the destination e-mail are managed in association with each other. Further, the file transmission unit 44 can accept an input of a mail address as a destination by an operation of an input device such as a touch panel by the user.

  The address book input unit 45 reads a list file of e-mail addresses from the USB memory 5 and manages it in the address book management table 410.

  The backup processing unit 46 performs backup by storing the file output by the file output unit 42 b and the file transmitted by the file transmission unit 44 in the backup data storage unit 420. If the user does not set backup, backup processing is not performed. The backup data is stored in the PDF format as shown in FIG.

  The backup output unit 47 stores the backed up file in the USB memory 5. In this storage, a password is input for security by an operation of an input device such as a touch panel by the user.

  The setting management unit 48 stores and reads various setting information of the electronic blackboard 2 in the setting file storage unit 430 for management. Examples of the various setting information include network settings, date and time settings, region and language settings, mail server settings, address book settings, connection destination list settings, and backup settings. The network setting is, for example, an IP address setting of the electronic blackboard 2, a net mask setting, a default gateway setting, a DNS (Domain Name System) setting, or the like.

  The setting file output unit 49b records various setting information of the electronic blackboard 2 in the USB memory 5 as a setting file. Note that the settings file cannot be viewed by the user due to security.

  The setting file input unit 49a reads a setting file stored in the USB memory 5 and reflects various setting information on various settings of the electronic blackboard.

  The address book input unit 50 reads a list file of connection destination IP addresses for remote sharing processing from the USB memory 5 and manages it in the connection destination management table 440. As shown in FIG. 13, in the connection destination management table 440, when the electronic blackboard 2 is a participating device that intends to participate in the remote sharing process, the user of the participating device plays a role as a host device. It is a table for managing beforehand in order to reduce the trouble of inputting the IP address of the electronic blackboard. In the connection destination management table 440, the name of the base where the electronic blackboard 2 as a hosting apparatus that can participate is installed and the IP address of the electronic blackboard 2 as the hosting apparatus are managed in association with each other.

  Note that the connection destination management table 440 may be omitted. In this case, however, the user of the participating device needs to input the IP address of the host device using an input device such as a touch panel in order to start remote request processing with the host device. Therefore, the user of the participating device obtains the IP address of the sponsoring device from the user of the sponsoring device by telephone or electronic mail.

  The participation base management table 450 is a table for managing an electronic blackboard as a participating device that is currently participating in the remote sharing process when the electronic blackboard is a sponsor device. In the participating site management table 450, as shown in FIG. 14, the name of the site where the participating electronic blackboard 2 is installed and the IP address of the electronic blackboard 2 are managed in association with each other. When there are a plurality of participating devices, a plurality of IP addresses are registered.

(Functional configuration of communication control unit 60)
Next, the functional configuration of the communication control unit 60 will be described with reference to FIG. FIG. 5 is a functional block diagram of the communication control unit 60. The communication control unit 60 controls communication with other electronic blackboards 2 and communication with the later-described communication control unit 70 in the server machine 90 via the communication network 9. Therefore, the communication control unit 60 includes a remote start processing unit 61, a remote participation processing unit 62, a remote image transmission unit 63, a remote image reception unit 64, a remote operation transmission unit 65, a remote operation reception unit 66, and a participation base management table 610. have.

  Among these, the remote start processing unit 61 makes a request for starting a new remote sharing process to the server machine 90 of the same electronic blackboard 2, and receives the request result from the server machine 90. In this case, the remote start processing unit 61 refers to the remote license management table 310 and makes a request to start remote sharing processing when license information (product ID, license ID, and expiration date) is managed. be able to. However, if the license information is not managed, a request to start remote sharing processing cannot be made.

  The participation base management table 610 is a table for managing an electronic blackboard as a participating device currently participating in the remote sharing process when the electronic blackboard is a sponsor device. In the participating site management table 610, as shown in FIG. 14, the name of the site where the participating electronic blackboard 2 is installed and the IP address of the electronic blackboard 2 are managed in association with each other.

  The remote participation processing unit 62 transmits the remote connection processing to the remote sharing processing to the remote connection request receiving unit 71 in the server 90 of the electronic blackboard 2 as the hosting device that has already started the remote sharing processing via the communication network 9. Request participation. Also in this case, the remote participation processing unit 62 refers to the remote license management table 310. In addition, when the remote participation processing unit 62 participates in the remote sharing process that has already been started, the IP address of the electronic blackboard 2 of the participation destination is acquired with reference to the connection destination management table 440. Note that the remote participation processing unit 62 may not input the connection destination management table, and may input the IP address of the electronic blackboard 2 as a participation destination by an operation of an input device such as a touch panel by the user.

  The remote image transmission unit 63 transmits the output image (C) sent from the video acquisition unit 21 via the image acquisition unit 31 to the server machine 90.

  The remote image receiving unit 64 receives image data from a video output device connected to another electronic blackboard 2 from the server machine 90 and outputs it to the display superimposing unit 36, thereby enabling remote sharing processing.

  The remote operation transmission unit 65 transmits various operation data necessary for remote sharing processing to the server machine 90. Examples of the operation data include adding a stroke, deleting a stroke, editing a stroke (enlarging, reducing, moving), storing page data, creating page data, duplicating page data, deleting page data, and displaying. Data related to the switching of the current page. In addition, the remote operation receiving unit 66 receives the operation data input from the other electronic blackboard 2 from the server machine 90 and outputs it to the image processing unit 30 to perform remote sharing processing.

[Functional configuration of server machine]
Next, the functional configuration of the server machine 90 will be described with reference to FIG. The server machine 90 is provided in each electronic blackboard 2, and any electronic blackboard 2 can serve as a server machine. Therefore, the server machine 90 includes a communication control unit 70 and a data management unit 80.

(Functional configuration of communication control unit 70)
Next, the functional configuration of the communication control unit 70 will be described with reference to FIG.

  The communication control unit 70 controls communication with the communication control unit 60 in the client machine 20 in the same electronic blackboard 2 and the communication control unit 70 in the client machine 20 in another electronic blackboard 2 via the communication network 9. . The data management unit 80 manages operation data, image data, and the like.

  More specifically, the communication controller 70 includes a remote connection request receiver 71, a remote connection result transmitter 72, a remote image receiver 73, a remote image transmitter 74, a remote operation receiver 75, and a remote operation transmitter 76. have.

  Among these, the remote connection request receiving unit 71 receives a remote sharing processing start request from the remote start processing unit 61 or receives a participation request for remote sharing processing from the remote participation processing unit 62. The remote connection result transmission unit 72 transmits the result of the remote sharing processing start request to the remote start processing unit 61 or transmits the result of the participation request for the remote sharing processing to the remote participation processing unit 62.

  The remote image receiving unit 73 receives the image data (data of the output image (C)) from the remote image transmitting unit 63 and transmits it to the remote image processing unit 82 described later. The remote image transmission unit 74 receives image data from the remote image processing unit 82 and transmits this image data to the remote image reception unit 64.

  The remote operation receiving unit 75 receives operation data (data such as a stroke image (B)) from the remote operation transmitting unit 65 and transmits it to the remote operation processing unit 83 described later. The remote operation transmission unit 76 receives operation data from the remote operation processing unit 83 and transmits this operation data to the remote operation reception unit 66.

(Functional configuration of the data management unit)
Next, the functional configuration of the data management unit 80 will be described with reference to FIG. The data management unit 80 includes a remote connection processing unit 81, a remote image processing unit 82, a remote operation processing unit 83, an operation composition processing unit 84, and a page processing unit 85. Further, the server 90 includes a passcode management unit 810, a participating site management table 820, an image data management unit 830, an operation data storage unit 840, a page data storage unit 850, and a function restriction management unit 860.

  Among these, the remote connection processing unit 81 starts the remote sharing process and ends the remote sharing process. The remote connection processing unit 81 also receives the license information received by the remote connection request receiving unit 71 from the remote start processing unit 61 together with the remote sharing processing start request or the remote sharing processing unit 62 from the remote sharing processing participation request. Based on the received license information, it is confirmed whether there is a license and whether it is within the license period. Further, the remote connection processing unit 81 confirms whether or not the participation request from the other electronic blackboard 2 as the client machine exceeds the predetermined number of possible participations.

  Further, the remote connection processing unit 81 has the same passcode that is sent when another electronic blackboard 2 has requested to participate in remote sharing processing as the passcode managed by the passcode management unit 810. It is determined whether or not there is the same, and if they are the same, participation in the remote sharing process is permitted. This passcode is issued by the remote connection processing unit 81 when a new remote sharing process is started, and the user of the electronic blackboard 2 as a participating apparatus who intends to participate in the remote sharing process can It is transmitted from the user of the electronic blackboard 2 by telephone or e-mail. As a result, the user of the electronic blackboard 2 as a participating device who intends to participate in the remote sharing process inputs the pass code to the electronic blackboard 2 and requests participation, thereby permitting participation. Note that the user's usability is given priority over security, and the confirmation of the passcode may be omitted only by confirming the license status.

  When the electronic blackboard 2 is the host device, the remote connection processing unit 81 uses the participation base information included in the participation request sent from the remote participation processing unit 62 of the participating device via the communication network 9 as the server unit. The data are stored in the 90 participating site management table 820. Then, the remote connection processing unit 81 reads out the remote site information stored in the participating site management table 820 and transmits it to the remote connection result transmission unit 72. The remote connection result transmission unit 72 transmits the remote base information to the remote start processing unit 61 in the client unit 20 of the same sponsor device. The remote start processing unit 61 stores the remote site information in 610 in the participating site management table. As a result, the host device manages remote site information in both the client unit 20 and the server unit 90.

  Further, the remote connection processing unit 81 acquires a function restriction list from the remote participation processing unit 62 of the client machine 20 via the remote connection request receiving unit 71. The remote connection processing unit 81 creates a remote conference ID that does not overlap, and stores the function restriction list in the function restriction management unit 860. In the function restriction list, as will be described later, it is registered whether or not the functions originally permitted to the participating devices are restricted.

  The remote image processing unit 82 receives image data from a video output device (node PC 6 or the like) connected to a client device of each electronic blackboard 2 (including a client device of its own electronic blackboard that is the hosting device) during remote sharing processing. (Output Image (C)) is received and stored in the image data storage unit 830, and the display order of the image data to be remotely shared in the time order received by the server device 90 of the electronic blackboard 2 that is the host device Determine. In addition, the remote image processing unit 82 refers to the participation base management table 820, and adds to all the client machines 20 of the electronic blackboard 2 participating in the remote sharing process (including the client machine of its own electronic blackboard that is the host device). The image data is transmitted in the determined order via the communication control unit 70 (remote image transmission unit 74).

  The remote operation processing unit 83 performs various types of operation data (stroke images (B, B, B) drawn on the client machine of each electronic blackboard 2 (including the client machine of its own electronic blackboard which is the hosting apparatus) during the remote sharing process. ) And the like, and the display order of the images to be remotely shared is determined in the order of time of arrival at the server 90 of the electronic blackboard 2 that is the host device. The various operation data is the same as the various operation data described above. Further, the remote operation processing unit 83 refers to the participating site management table 820 and operates the operation data on all the client machines 20 of the electronic blackboard 2 (including the client machine of its own electronic blackboard which is the hosting apparatus) during the remote sharing process. Send.

The operation synthesis processing unit 84 synthesizes the operation data of each electronic blackboard 2 output from the remote operation processing unit 83, stores the operation data as a result of this synthesis in the operation data storage unit 840 and the remote operation processing unit 83. Return to. The operation data is transmitted from the remote operation transmission unit 76 to each of the electronic blackboard client machine that is the hosting apparatus and the electronic blackboard client machine that is the participating apparatus. Such an image is displayed. Therefore, as shown in FIG. 15, the operation data includes SEQ (Sequence), the operation name of the operation data, the IP address of the electronic blackboard 2 that is the transmission source of the operation data, and the Port of the client machine (server machine). No., the IP address of the electronic blackboard 2 to which the operation data is sent, the port number of the client machine (server machine), the operation type of the operation data, the operation target of the operation data, and the data indicating the contents of the operation data Shown. For example, in SEQ1, when a stroke is drawn on the client machine (Port No .: 50001) of the electronic blackboard (IP address: 192.0.0.1) as the hosting device, the electronic blackboard (IP address: 192.0. 0.1) indicates that operation data has been sent to the server machine (Port No .: 50000). In this case, the operation type is “STROKE”, the operation object is the page data ID “p005”, and the data indicating the contents of the operation data is data indicating the stroke. In SEQ2, the client computer of the electronic blackboard (IP address: 192.0.0.1) that is the participating device from the server device (Port No .: 50000) of the electronic blackboard (IP address: 192.0.0.1) that is the host device. (Port No .: 50001) indicates that operation data has been sent.
The operation composition processing unit 84 performs composition in the order in which the operation data is input to the operation composition processing unit 84. Therefore, if the communication network 9 is not congested, remote sharing is performed in the order of strokes by the users of the electronic blackboards 2. A stroke image (B) is displayed on the displays 3 of all the electronic blackboards 2 being processed.

  The page processing unit 85 has the same function as the page processing unit 37 in the image processing unit 30 of the client machine 20, and the server machine 90 also converts the page data shown in FIGS. 6 to 8 into a page data storage unit. Store in 850. Note that the page data storage unit 850 has the same contents as the page data storage unit 300 in the image processing unit 30, and therefore the description thereof is omitted.

  FIG. 16 is an example of a diagram schematically illustrating a function restriction list stored in the function restriction management unit 860. In the function restriction list, the presence / absence of restriction of each function is associated with the remote conference ID. In FIG. 16, the remote conference ID is the IP address of the hosting device that hosts the remote conference. However, the remote conference ID may be an identifier that uniquely specifies the conference, and may be any numerical value, alphabet, character, or symbol. A combination may be used.

  Functions that can be performed by the client machine 20 participating in the conference are USB memory storage, mail transmission, page printing, file reading, page creation, screen capture, recovery, backup, video input, page deletion, page duplication, and page switching. , Page write, etc. In order to specify the function, each function is given a unique identifier in advance. For example, the identifier of the function of saving in the USB memory is “SAVE01”.

  Further, “FALSE” is set when each function is restricted, and “TRUE” is set when each function is not restricted. For example, in the remote conference with the remote conference ID = 123.123.123.123, there is no function restriction on the client machine to participate. In the remote conference with the remote conference ID = 123.123.123.124, some functions are limited, and in the remote conference with the remote conference ID = 123.123.123.125, all functions are limited.

(UI image regarding function restriction)
17 to 19 are diagrams illustrating an example of a function restriction list creation screen. The UI image generation unit 33 creates the screen of FIG. 17 by operating the electronic blackboard 2 when the user of the hosting device holds a meeting. In FIG. 17, a message 201 “A function of a participant can be restricted by selecting the following items”, a save function (an example of a save operation of claims), an edit function (claim claims) And a check box 203 for selecting a display function (an example of a display operation of claims). Functions for which the check box 203 is checked are restricted. Since the image displayed on the display 3 (for example, page data, an image displayed by opening a file) can be stored in the storage function, security can be improved by limiting the storage function.

  The storage function, the editing function, and the display function are a combination of the respective functions, and all functions classified into the storage function, the editing function, and the display function can be restricted by checking the check box 203 by the user. Further, when the user presses the detail button 202, as shown in FIG. 18, detailed functions classified into the storage function are displayed. The details of each function are also displayed for the editing function and the display function.

  The hold button 204 is a button for holding a conference. When the holding button 204 is pressed, the restriction receiving unit 261 receives a function restriction. As a result, the remote participation processing unit 62 of the client machine 20 transmits the holding request and the function restriction list to the remote connection request receiving unit 71 of the server machine 90. A cancel button 205 is a button for ending the creation screen without holding a meeting.

  FIG. 18 is a diagram illustrating an example of a function restriction list creation screen when the edit function detail button 202 is pressed. When an individual function is displayed, the detail button 202 changes to a return button 207, and the individual function item can be hidden by pressing the return button 207. The storage function is, for example, storage in a USB memory, mail transmission, page printing, backup, and recovery. Since a check box 206 is arranged for each, the user can select and restrict an arbitrary function.

  When the detailed button 202 of the edit function is pressed, a page creation, screen capture, page deletion, page duplication, page writing, and the like, together with check boxes, are provided as specific editing functions classified into the edit function. Is displayed. By restricting page creation and page writing, the writing of confidential information can be restricted, so that security can be improved. Since the screen capture is restricted, the screen displayed on the PC 6 cannot be saved, so that security can be improved. Restricting page duplication makes it difficult to distribute page data, thus improving security. By restricting page deletion, loss of page data can be prevented. Also, if page creation, page writing, etc. are restricted, it becomes easier for the user of the hosting device to control the progress of the conference.

  When the detail button 202 of the display function is pressed, file reading, page switching, video input, and the like are displayed together with check boxes as specific display functions classified as display functions. Since the contents displayed on the display 3 from the participating device cannot be changed, the user of the sponsoring device can easily control the progress of the conference. Further, by restricting file reading, it becomes difficult to display the contents of any file held by the participating devices, and security can be improved. By restricting the video input, it becomes difficult to display the video held by the participating devices, and the security can be improved.

  FIG. 19 shows an example of a screen displayed on the display 3 by the participating devices participating in the remote conference. In FIG. 19, the restricted functions are displayed together with the message 210 “The following functions are restricted, but will you participate?”. In this screen, the participation apparatus that has requested participation in the server machine 90 receives the function restriction list stored in the function restriction management unit 860 from the server machine 90 and displays it.

  The UI image generation unit 33 of the participating device displays the screen in FIG. 19 with reference to the function restriction list. Also in FIG. 19, the save function, the edit function, and the display function are a collection of the respective functions, and when the user presses the detail button 202, the detailed contents of the restriction can be displayed. The user can grasp the restriction of the meeting to join and determine whether or not to join. When the join button 208 is pressed, a join request is transmitted to the server device 90 of the hosting device, and when the cancel button 209 is pressed, the screen of FIG. 19 ends.

<Process or Operation of Embodiment>
Next, the processing or operation of this embodiment will be described with reference to FIGS. 21 to 23 are sequence diagrams illustrating processing of each electronic blackboard.

  In the embodiment shown in FIGS. 21 to 23, the electronic blackboard 2a serves as a hosting device (server machine and client machine) that hosts the remote sharing process, and the electronic blackboards 2b and 2c participate in the remote sharing process. The case where it plays a role as (client machine) will be described. Further, here, the displays 3a, 3b, 3c are connected to the electronic blackboards 2a, 2b, 2c, respectively, and further notebook PCs 6a, 6b, 6c are connected respectively. Moreover, in the electronic blackboards 2a, 2b, and 2c, electronic pens 4a, 4b, and 4c are used, respectively.

  FIG. 21 shows an example of a sequence diagram in which the electronic blackboard 2a holds a remote conference with function restrictions.

  The user of the electronic blackboard 2a operates the function restriction list creation screen created by the UI image generation unit 33 and presses the button 204 to be held. Thereby, the restriction receiving unit 261 creates a function restriction list. The image processing unit 30 of the client machine 20 outputs the function restriction list to the remote participation processing part 62, and the remote participation processing part 62 transmits a remote conference holding request and the function restriction list to the server machine (S1).

  The remote connection request receiving unit 71 of the server machine 90 receives the remote conference holding request and the function restriction list, and outputs them to the remote connection processing unit 81. As a result, the remote connection processing unit 81 performs a remote conference start process (S2). Specifically, a remote conference ID is created, and the function restriction list is stored in the function restriction management unit 860 in association with the remote conference ID.

  When the function restriction list is stored, the remote connection processing unit 81 transmits a holding permission to the remote start processing unit 61 of the client machine 20 via the remote connection result transmission unit 72 (S3).

(Participation process)
Next, a process for the electronic blackboards 2b and 2c to participate in the remote sharing process will be described with reference to FIG.

  When the user turns on the power switch of the electronic blackboard 2a, the client unit 20 of the electronic blackboard 2a is activated. When the user performs an operation to activate the server unit 90 using an input device such as a touch panel, the server unit 90 is transferred from the remote start processing unit 61 of the client unit 20 to the remote connection request receiving unit 71 in the server unit 90 of the same electronic blackboard 2a. An instruction to start the process is output. Thereby, in the electronic blackboard 2a, not only the client unit 20 but also the server unit 90 can start various processes (step S21).

  Next, the UI image generation unit 33 in the client machine 20 of the electronic blackboard 2a generates connection information for establishing a connection with the electronic blackboard 2a, and the video superimposition unit 28 receives the display superimposition unit 36 from the UI image generation unit 33. The connection information obtained through is displayed on the display 3a (step S22). This connection information includes the host device's IP address and the passcode generated for the current remote sharing process. In this case, the passcode stored in the passcode management unit 810 is read by the remote connection processing unit 81 shown in FIG. 5 and transmitted in the order of the remote connection result transmission unit 72 and the remote start processing unit 61. The Further, the passcode is transmitted from the communication control unit 60 including the remote start processing unit 61 to the image processing unit 30 illustrated in FIG. 3 and finally input to the UI image generation unit 33. Thereby, the connection information includes the passcode. Then, the connection information is transmitted to the users of the electronic blackboards 2b and 2c by telephone or electronic mail by the user of the electronic blackboard 2a. If there is the connection destination management table 440, even if the connection information does not include the IP address of the hosting device, the participating device can make a participation request.

  Next, in the electronic blackboards 2b and 2c, when input of connection information is received by the operation of an input device such as a touch panel by each user, the remote participation processing unit 62 in the client machine 20 of each electronic blackboard 2a and 2b Based on the IP address, a participation request is made by transmitting a pass code to the remote connection request receiving unit 71 in the server 90 of the electronic blackboard 2a via the communication network 9 (steps S23 and S24). As a result, the remote connection request receiving unit 71 of the communication control unit 70 receives a participation request (including a passcode) from each of the electronic blackboards 2b and 2c, and outputs this passcode to the remote connection processing unit 81. At this time, the electronic blackboards 2b and 2c transmit the remote conference ID to the electronic blackboard 2a.

  Next, the remote connection processing unit 81 authenticates the passcode received from each client machine 20 of the electronic blackboards 2b and 2c using the passcode managed by the passcode management unit 810 (step S25). And the remote connection result transmission part 72 notifies an authentication result to the client machine 20 of each electronic blackboard 2b, 2c (S step S26, S27). If it is determined by the authentication in step S25 that the electronic blackboard is a legitimate electronic blackboard, communication of remote sharing processing is established between the electronic blackboard 2a that is the hosting device and the electronic blackboards 2b and 2c that are participating devices. The remote participation processing unit 62 in the client machine 20 of each electronic blackboard 2b, 2c enables the start of remote sharing processing with each other electronic blackboard (steps S28, S29).

  The remote connection processing unit 81 of the electronic blackboard 2a performs a remote conference participation process (S29-1). Specifically, the function restriction management unit 860 is searched using the remote conference ID as a key, and the function restriction list associated with the remote conference ID is read.

  The remote connection processing unit 81 of the electronic blackboard 2a requests the electronic blackboards 2b and 2c to restrict functions (S29-2 and 29-3). Specifically, the function restriction list is transmitted and displayed on the client device 20 of the electronic blackboards 2b and 2c.

  The client machines 20 of the electronic blackboards 2b and 2c perform function restriction processing (S29-4 and 29-5). In the function restriction process, as shown in FIG. 19, the UI image generation unit 33 of the client machine 20 displays a function restricted in a meeting to join by using the function restriction list. Further, when the participation button 208 is pressed on the screen of FIG. 19, the operation restriction unit 331 creates a UI image according to the function restriction. The UI images whose functions are limited will be described with reference to FIGS.

  When the user of the electronic blackboards 2b and 2c presses the join button 208 on the screen of FIG. 19, the remote participation processing unit 62 of the electronic blackboards 2b and 2c transmits a function restriction contract to the electronic blackboard 2a (S29-6, 29-). 7).

  The remote connection processing unit 81 of the electronic blackboard 2a performs participation registration processing (S29-8). That is, the IP address of the participating device is registered in the participating base management table 820.

  The remote connection processing unit 81 of the electronic blackboard 2a transmits participation permission to the electronic blackboards 2b and 2c (S29-9, 29-10).

(Output image display)
First, the electronic blackboard 2b displays the output image (C) on the display 3b (step S30). Specifically, the image acquisition unit 31 of the electronic blackboard 2b receives the data of the output image (C) displayed on the notebook PC 6b from the notebook PC 6b via the video acquisition unit 21, and displays the display superimposing unit 36 and the video. By transmitting to the display 3b via the superimposing unit 28, the display 3b displays the output image (C).
Next, the image processing unit 30 including the image acquisition unit 31 of the electronic blackboard 2 b transmits the output image (C) data to the remote image transmission unit 63, so that the communication control unit 60 including the remote image transmission unit 63 is performed. The data of the output image (C) is transmitted to the communication control unit 70 of the electronic blackboard 2a that is the hosting device via the communication network 9 (step S31). Thereby, the remote image receiving unit 73 of the electronic blackboard 2a receives the output image (C) data and outputs it to the remote image processing unit 82, so that the remote image processing unit 82 outputs the output image to the image data storage unit 830. The data of (C) is stored.
Next, the electronic blackboard 2a that is the hosting device displays the output image (C) on the display 3a (step S32). Specifically, the remote image processing unit 82 of the electronic blackboard 2 a outputs the output image (C) data received from the remote image receiving unit 73 to the remote image transmitting unit 74. The remote image transmitting unit 74 outputs the data of the output image (C) to the remote image receiving unit 64 in the client unit 20 of the electronic blackboard 2a which is the same host device. The remote image receiving unit 64 outputs the data of the output image (C) to the display superimposing unit 36. The display superimposing unit 36 outputs the output image (C) data to the video superimposing unit 28. The video superimposing unit 28 outputs the data of the output image (C) to the display 3a. Thereby, the display 3a displays the output image (C).
Next, the communication control unit 70 including the remote image transmission unit 74 in the server unit 90 of the electronic blackboard 2a as the hosting device via the communication network 9 is the electronic blackboard 2b that is the transmission source of the data of the output image (C). The data of the output image (C) is transmitted to the communication control unit 60 of the electronic blackboard 2c other than (step S33). Thereby, the remote image receiving part 64 of the electronic blackboard 2c which is a participating apparatus receives the data of an output image (C).
Next, the electronic blackboard 2c displays the output image (C) on the display 3c (step S34). Specifically, the remote image receiving unit 64 of the electronic blackboard 2c outputs the data of the output image (C) received in step S33 to the display superimposing unit 36 of the electronic blackboard 2c. The display superimposing unit 36 outputs the output image (C) data to the video superimposing unit 28. The video superimposing unit 28 outputs the data of the output image (C) to the display 3c. Thereby, the display 3c displays the output image (C).
When not only the output image (C) data but also the UI image (A) and stroke image (B) data are input to the display superimposing unit 28, the display superimposing unit 36 superimposes them. An image (A, B, C) is generated, and the video superimposing unit 28 outputs the data of the superimposed image (A, B, C) to the display 3c. When video conferencing video (E) data is sent from the video conference terminal 7 to the video superimposing unit 28, the video superimposing unit 28 converts the video superimposing image (A, B, C). The video (E) data for video conference is superimposed by picture-in-picture and output to the display 3c.
(Display of superimposed image)
Next, operation data processing in remote sharing processing will be described.

  First, in the electronic blackboard 2b, the user draws a stroke image (B) on the electronic blackboard 2b using the electronic pen 4b (step S41).

  Next, as shown in FIG. 20, the display superimposing unit 36 in the client machine 20 of the electronic blackboard 2b performs strokes on the UI image (A), the output image (C), and the background image (D). The image (B) is superimposed, and the video superimposing unit 28 displays the superimposed superimposed images (A, B, C, D) on the display 3b of the electronic blackboard 2b (step S42). Specifically, the stroke processing unit 32 of the electronic blackboard 2b receives the stroke image (B) data as the operation data from the coordinate detection unit 21 and the contact detection unit 24 via the event distribution unit 25, and displays the superimposed image. It transmits to the part 36. Accordingly, the display superimposing unit 36 can superimpose the stroke image (B) on the UI image (A) and the output image (C), and the video superimposing unit 28 is placed on the display 3b of the electronic blackboard 2b. The superimposed image (A, B, C) can be displayed.

  Next, the image processing unit 30 including the stroke processing unit 32 of the electronic blackboard 2b transmits the stroke image (B) data to the remote operation transmission unit 65, so that the remote operation transmission unit 65 of the electronic blackboard 2b communicates. The data of the stroke image (B) is transmitted via the network 2 to the communication control unit 70 of the electronic blackboard 2a that is the hosting device (step S43). Thereby, the remote operation receiving unit 75 of the electronic blackboard 2a receives the data of the stroke image (B) and outputs it to the remote operation processing unit 83, so that the remote operation processing unit 83 sends the stroke image to the operation composition processing unit 84. The data of (B) is output. In this way, the data of the stroke image (B) drawn on the electronic blackboard 2b is sequentially transmitted to the remote operation processing unit 83 of the electronic blackboard 2a that is the hosting device every time it is drawn. The data of the stroke image (B) is data shown for each stroke data ID shown in FIG. Therefore, for example, as described above, when the user draws the alphabet “T” with the electronic pen 4, the stroke image (B) indicated by each of the two stroke data IDs is sequentially transmitted. Is done.

Next, the electronic blackboard 2a, which is the hosting device, displays on the display 3a a superimposed image (A, B, C) including the data of the stroke image (B) sent from the electronic blackboard 2b (Step S). S44). Specifically, the operation composition processing unit 84 of the electronic blackboard 2a synthesizes the data of the plurality of stroke images (B) sequentially sent via the remote operation processing unit 83 and stores them in the operation data storage unit 840. Store and return to the remote operation processing unit 83. Thereby, the interval operation processing unit 83 outputs the data of the combined stroke image (B) received from the operation combining processing unit 84 to the remote operation transmitting unit 76. The remote operation transmitting unit 76 outputs the combined stroke image (B) data to the remote operation receiving unit 66 in the client unit 20 of the electronic blackboard 2a which is the same hosting device. The remote operation receiving unit 66 outputs the combined stroke image (B) data to the display superimposing unit 36 in the image processing unit 30. Therefore, the display superimposing unit 36 superimposes the combined stroke image (B) on the UI image (A) and the output image (C). Finally, the video superimposing unit 28 displays the superimposed image (A, B, C) superimposed by the display superimposing unit 36 on the display 3a.
Next, the communication control unit 70 including the remote operation transmission unit 76 in the server unit 90 of the electronic blackboard 2a as the hosting device via the communication network 9 is the electronic blackboard 2b that is the transmission source of the stroke image (B) data. The composite stroke image (B) data is transmitted to the communication control unit 60 of the electronic blackboard 2c other than (step S45). Thereby, the remote operation receiving part 66 of the electronic blackboard 2c which is a participating apparatus receives the data of the synthesized stroke image (B).
Next, the electronic blackboard 2c displays the superimposed image (A, B, C) on the display 3c (step S34). Specifically, the remote operation receiving unit 66 of the electronic blackboard 2c outputs the combined stroke image (B) data received in step S45 to the image processing unit 30 of the electronic blackboard 2c. The display superimposing unit 36 of the image processing unit 30 superimposes each data of the UI image (A) and the output image (C) and the data of the combined stroke image (B), and superimposes the superimposed image ( A, B, C) data is output. The video superimposing unit 28 outputs the data of the superimposed image (A, B, C) to the display 3c. Thereby, the display 3c displays a superimposed image (A, B, C).
In the above processing, the output image (C) is displayed on the display 3, but a background image (D) may be displayed instead of the output image (C). Alternatively, the exclusive relationship between the output image (C) and the background image (D) may be stopped, and both the output image (C) and the background image (D) may be displayed on the display 3 at the same time.
(End of participation)
Next, a process in which the participating device ends participation in the remote sharing process will be described with reference to FIG. In the embodiment shown in FIG. 23, a process is shown in which the electronic blackboard 2c finishes participation.

First, in the electronic blackboard 2c, when an end request for participation is received by an operation of an input device such as a touch panel by the user, the remote participation processing unit 62 sends a communication control unit 70 in the server unit 90 of the electronic blackboard 2a as a host device to the communication control unit 70. A request to end participation is made (step S47). Thereby, the remote connection request receiving unit 71 of the communication control unit 70 receives the participation end request from the electronic blackboard 2c, and outputs the participation end request together with the IP address of the electronic blackboard 2c to the remote connection processing unit 81. . Then, the remote connection processing unit 81 of the electronic blackboard 2a, based on the IP address sent from the remote connection request receiving unit 71, from the participation base management table 820, the IP of the electronic blackboard 2c that has requested participation. The address and the name of the base where the electronic blackboard 2c is installed are deleted, and the remote connection result transmission unit 72 outputs the IP address of the electronic blackboard 2c and a notification of the deletion.
Next, the communication control unit 70 including the remote connection result transmission unit 72 instructs the communication control unit 60 in the client unit 20 of the electronic blackboard 2c to end participation via the communication network 9 (step S48). As a result, the remote participation processing unit 62 of the communication control unit 60 in the electronic blackboard 2c disconnects the communication of the remote sharing process, thereby completing the participation process, thereby completing the participation (step S49).

  21 to 23, the client machine provides an image frame, but the server machine may transmit the image frame. In this embodiment, a client machine that provides an image frame transmits drawing information. However, other client machines or server machines may transmit drawing information. Furthermore, in this embodiment, a client machine that does not provide an image frame transmits a position instruction event, but a server machine that does not provide an image frame may transmit position instruction event information.

(Example of function restriction)
FIG. 24 shows an example of a UI image displayed on the display 3. In this UI image, icons are displayed on the right side and the lower side of the display 3, respectively. These icons make it impossible for the operation restriction unit 331 to select a function in the UI image, so that the operation of the user of the participating device can be restricted with certainty. These icons are examples of display parts in claims.

  FIG. 25 is an example of a diagram for explaining the correspondence between the function when the user selects each icon on the right side of the UI image and the function restriction. The pen icon is an icon for the user to write characters and the like on the whiteboard, and the user can change the color and thickness of the pen. When “Write Page” is checked on the function restriction list creation screen, the pen icon cannot be selected. Examples of display methods that cannot be selected include black-and-white reversal, non-display of the icon itself, and drawing a cross mark on the icon.

  The selection / deletion icon is an icon for selecting a stroke written on the whiteboard, enlarging / reducing, moving, or deleting. When “write page” is checked on the function restriction list creation screen, the selection / deletion icon cannot be selected.

  The capture icon is an icon for the user to capture the content written on the display and record it on the page. When displaying the video of a connected device such as a personal computer, the displayed video is also recorded. When “Screen Capture” is checked on the function restriction list creation screen, the capture icon cannot be selected.

  The new page icon is an icon for the user to display a new page. When “Create Page” is checked on the function restriction list creation screen, the new page icon cannot be selected.

  The page feed icon is an icon for displaying the next page of the displayed page. When “page switching” is checked on the function restriction list creation screen, the page feed icon cannot be selected.

  The page return icon is an icon for displaying the page before the displayed page. When “page switching” is checked on the function restriction list creation screen, the page return icon cannot be selected.

  The USB memory icon is an icon for saving all capture pages as PDF files and storing them in the USB memory. When “Save to USB memory” is checked on the function restriction list creation screen, the USB memory icon cannot be selected.

  The email storage icon is an icon for sending all captured pages as PDF files by email. When “Mail transmission” is checked on the function restriction list creation screen, the mail storage icon cannot be selected.

  FIG. 26 is an example of a diagram for explaining the correspondence between the function when the user selects each lower icon and the function restriction.

  The page icon is a thumbnail of a recorded page. The user can select any thumbnail and display it on the screen. When “page switching” is checked on the function restriction list creation screen, the page icon cannot be selected.

  The page deletion icon is an icon for deleting the displayed page. When “Delete page” is checked on the function restriction list creation screen, the page deletion icon cannot be selected.

  The screen page icon is an icon for displaying / switching the image of the device connected to the computer input. When “video input” is checked on the function restriction list creation screen, the screen page icon cannot be selected.

  As described above, since the operation restriction unit 331 disables selection of functions in the UI image, the operation of the user at the base can be restricted with certainty.

  The present invention is not limited to such an embodiment, and the function restriction management unit 860 may be stored in the client machine instead of the server machine, or may be stored on the network. Further, in the present embodiment, the function restriction of the participation apparatus has been described, but the function restriction may be applied to the host apparatus. In addition, although the host device has accepted the function restriction setting, the participating device may accept the function restriction setting.

  In the first embodiment, the host device uniformly restricts the functions of a plurality of participating devices, but in this embodiment, an image processing system 1 that restricts the functions individually for each participating device will be described.

  The user of the electronic blackboard 2b, 2c may request the user of the electronic blackboard 2a to relax the restriction by voice or the like, or the user of the electronic blackboard 2a confirms the participation devices 2b, 2c and voluntarily, for example, the participation device 2b. Limits may only be tightened or relaxed.

  The user of the electronic blackboard 2 a who wants to control the restriction of any participating device displays a function restriction list creation screen on the display 3.

  FIG. 27 is a diagram illustrating an example of a function restriction list creation screen according to the present embodiment. In FIG. 27, an IP address selection field 213 is displayed together with a message 211 “participant's functions are individually restricted” with respect to FIG. In this selection field 213, all IP addresses registered in the participating base management table are registered. The base name may be displayed instead of the IP address.

  The user of the electronic blackboard 2a selects a participating device whose restriction is to be relaxed or to be strengthened individually from the selection column 213, and creates a function restriction list as in FIG. When the user individually presses the restriction button 212, the client machine 20 of the electronic blackboard 2a transmits the function restriction list to the server machine 90 together with the IP address of the participating device. The remote connection processing unit 81 of the server machine 90 records a function restriction list in association with the IP address of the participating device.

  FIG. 28 is an example of a diagram schematically illustrating a function restriction list of a function restriction management unit according to the present embodiment. In this embodiment, as many function restriction lists as the number of participating devices can be recorded for one remote conference ID. As illustrated, not all functions are restricted on the electronic blackboard 2b, but page creation and the like are restricted on the electronic blackboard 2c. In this way, the user of the sponsoring device can create a function restriction list for each participating device.

  The remote connection processing unit 81 of the server machine 90 transmits the function restriction list associated with the IP address to the participating device specified by the IP address. Thereby, since the participating devices 2b and 2c perform the function restriction process again, the operation restriction unit 331 can create and display on the display 3 a UI image that allows the user to select individually restricted functions.

  In this embodiment, the restriction on the function of the participating device can be individually relaxed or strengthened in this way.

  In the first and second embodiments, the functions of the participating devices are statically restricted based on the function restriction list. However, in this embodiment, an image processing system 1 that can temporarily relax the restricted functions will be described.

  As a user of the hosting device, it is safe to restrict the functions of participating devices strictly in principle, but depending on the content of the discussion, it may not be necessary to restrict the storage function, editing function, display function, etc. . It is also possible for the hosting device to send page data or the like by e-mail after the conference is over, but after the conference is over, selecting page data is cumbersome and takes time. For this reason, it is considered that some page data may be desired to be distributed during the conference.

  Therefore, the image processing system 1 according to the present embodiment enables the user of the hosting device to relax the restriction temporarily.

  FIG. 29 is a diagram illustrating an example of a function restriction list creation screen according to the present embodiment. The user of the electronic blackboard 2 a who wants to temporarily relax the restrictions on the participating devices displays a function restriction list creation screen on the display 3.

  In FIG. 29, a time selection field 215 is displayed together with a message 216 “Temporarily relax the restriction”. In this selection column 215, a time for relaxing the restriction is registered. The user selects a time for which the restriction is temporarily relaxed from the selection column.

  The user of the electronic blackboard 2a relaxes the restriction by unchecking the check box 203 from the storage function, editing function, or display function. Thereby, the restriction | limiting of arbitrary functions can be selectively eased. Note that the restriction on all functions may be relaxed instead of unchecking the check boxes 203 for individual functions.

  Further, the functions of all the participating devices may not be alleviated uniformly, but the restriction may be temporarily relaxed by designating the participating devices.

  When the user presses the relax button 214, the client machine 20 of the electronic blackboard 2a transmits a function restriction list to the server machine 90. The remote connection processing unit 81 of the server machine 90 records a function restriction list that is temporarily effective with respect to a function restriction list before relaxation (hereinafter referred to as an original).

  FIG. 30 is an example of a diagram schematically illustrating the function restriction list of the function restriction management unit according to the present embodiment. In the present embodiment, a temporarily effective function restriction list is recorded for the original remote conference ID. In the original function restriction list, page creation or the like is restricted, but not all functions are restricted in the temporarily valid function restriction list (participating devices can use all functions).

  The remote connection processing unit 81 of the server machine 90 transmits a temporarily effective function restriction list to each participating device. Thereby, since the participating devices 2b and 2c perform the function restriction process again, the operation restriction unit 331 can create a UI image whose function is not restricted and display it on the display 3.

  Also, the remote connection processing unit 81 of the server machine 90 transmits the original function restriction list to each participating device when a predetermined time (10 minutes in the figure) elapses. Accordingly, the participating devices 2b and 2c perform the function restriction process again, and the operation restriction unit 331 can create a UI image with a restricted function and display it on the display 3.

  In the present embodiment, the restriction on the operation of the participating device can be temporarily relaxed in this way.

1 Image processing system 2 Electronic blackboard (an example of an image processing device)
3 Display (an example of display means)
4 Electronic pen 5 USB memory 6 Notebook PC (an example of information processing terminal)
7 Video conference terminal 8 PC
DESCRIPTION OF SYMBOLS 9 Communication network 20 Client machine 30 Image processing part 60, 70 Communication control part 80 Data management part 90 Server machine

Japanese Patent No. 5081088

Claims (6)

A system in which a plurality of information processing devices connected via a network communicate with each other,
The information processing apparatus includes a limit accepting unit that accepts an operation restriction setting that restricts another information processing apparatus from accepting an operation;
Transmission means for transmitting information based on the setting of the operation restriction to the other information processing apparatus,
The restriction accepting unit is a saving operation for saving an image displayed on a display unit connected to the other information processing apparatus, an editing operation for editing an image displayed on the display unit, or the other information processing. By accepting restrictions on display operations that display images on the device,
A plurality of operations classified as the saving operation, a plurality of operations classified as the editing operation, or a plurality of operations classified as the display operation are collectively accepted,
The other information processing apparatus
A system that restricts the acceptance of an operation by an operation accepting unit of the other information processing apparatus based on information based on the setting of the operation restriction. The restriction accepting means is one or more of a plurality of operations classified as the saving operation, one or more of a plurality of operations classified as the editing operation, and one of a plurality of operations classified as the display operation. Accept one or more restrictions individually,
The system according to claim 1 . The operation accepting unit accepts an operation corresponding to the display component when the display component displayed on the display unit is selected by a pointing device,
The other information processing apparatus displays or does not display the display component corresponding to the operation restricted by the information based on the operation restriction by the pointing device,
The system according to claim 1 or 2, characterized by the above. The restriction accepting unit accepts setting of an operation restriction together with designation of another information processing apparatus,
The transmission unit, the system according to claim 1 for transmitting information based on the handling restriction for each of the other information processing apparatus is specified, it is characterized. The restriction accepting unit accepts designation of time, and permits the restriction of the operation restricted by the information based on the operation restriction only for the time.
The system according to any one of claims 1 to 4 . An information processing apparatus that communicates with another information processing apparatus connected via a network,
Restriction accepting means for accepting an operation restriction setting for restricting at least other information processing apparatuses to accept an operation;
Limiting means for transmitting information based on the operation restriction to the other information processing apparatus and restricting the acceptance of the operation by the operation accepting means of the other information processing apparatus,
The restriction accepting unit is a saving operation for saving an image displayed on a display unit connected to the other information processing apparatus, an editing operation for editing an image displayed on the display unit, or the other information processing. By accepting restrictions on display operations that display images on the device,
An information processing apparatus that collectively accepts restrictions on a plurality of operations classified as the saving operation, a plurality of operations classified as the editing operation, or a plurality of operations classified as the display operation .

Images