JP5884444B2 - Electronic conference support device, electronic conference system, display device, terminal device, image forming device, control method for electronic conference support device, and control program for electronic conference support device - Google Patents

Description

  The present invention relates to an electronic conference support device, an electronic conference system, a display device, a terminal device, an image forming apparatus, a control method for an electronic conference support device, and a control program for an electronic conference support device, and more particularly to a display device used in a conference. The present invention relates to an electronic conference support apparatus, an electronic conference system, a display device, a terminal device, an image forming apparatus, an electronic conference support apparatus control method, and an electronic conference support apparatus control program that control information to be displayed.

  An electronic conference is held in which a conference is performed using devices connected via a network such as a local information communication network (LAN). There are various types of electronic conferences such as those held between different points via the Internet and those held in cooperation with a plurality of devices at the same point.

  In recent years, as electronic conferences, participants gathered in the same conference room, etc., and information that each participant brought to the screen displayed on a display device (electronic blackboard, whiteboard, other display, projector, etc.) ( In some cases, a form that displays opinions, materials, etc.) and attempts to aggregate opinions of participants is performed. In order to conduct such an electronic conference conveniently, by touching the position of the display device on which the user's terminal device is to be displayed, it is possible to display the opinion and reference information at a favorite position, and to collect opinions with good operability. A system has been proposed.

  In the following Patent Document 1, each attendee inputs and creates a memo representing the content of an idea on a portable terminal, and the portable terminal is brought into contact with the display screen, thereby displaying the memo on the display screen of the display device. An image management apparatus is disclosed that enables the user to do so.

  In the following Patent Document 2, an image of a mobile terminal is displayed in a size corresponding to the predetermined operation by bringing the mobile terminal into contact with the display device and performing a predetermined operation while displaying the image on the mobile terminal. An image pasting system that can be displayed on an apparatus is disclosed.

JP 2010-205137 A JP 2007-316925 A

  By the way, in the electronic conference as described above, not only the information brought by the user is displayed on the display device as described in Patent Document 1 and Patent Document 2, but also the information displayed on the display device, that is, It is more convenient if the information on the shared screen can be easily taken into the terminal device held by the user.

  The present invention has been made to solve such problems, and an electronic conference support apparatus, an electronic conference system, a display apparatus, a terminal apparatus, and an image forming apparatus that can easily incorporate information of a display apparatus into a terminal apparatus. It is an object of the present invention to provide a control method for an electronic conference support apparatus and a control program for the electronic conference support apparatus.

In order to achieve the above object, according to one aspect of the present invention, a user terminal that communicates a part of an image displayed on a display surface of a display device having a plurality of communication units with a plurality of communication units The electronic conference support device to be transmitted to the device uses a plurality of communication units to detect that the terminal device and the display surface are close to each other, and when the proximity is detected by the detection device First acquiring means for acquiring first information related to a position close to the terminal device on the display surface by grasping which of the plurality of communication units is used for communication ; A second acquisition unit configured to acquire second information for identifying the terminal device when the detection unit detects proximity, and a first acquisition unit out of images displayed on the display surface. Predetermined based on the first information acquired by Extracting means for extracting an image area, based on the second information acquired by the second acquisition unit, the information of the extracted image by extracting means and transmitting means for transmitting to the terminal device, a plurality The information included in the terminal device or the information included in the display device including the image data related to the image can be transferred between the communication unit and the terminal device .

  Preferably, the extraction unit determines whether or not to perform extraction on the image according to the attribute of the image displayed on the display surface.

  Preferably, the extraction unit extracts only one image or only both images of the image associated with the terminal device and the image associated with the other terminal device.

  Preferably, the electronic conference support apparatus is arranged such that after the image is transmitted to the terminal device by the transmission unit, the second detection unit detects that the terminal device is close to the display surface, and the second detection unit is closer. Display control means for performing control to display an image based on information sent from the terminal device on the display surface.

  Preferably, when it is detected that the display control unit is close by the second detection unit, an image is displayed at a position on the display surface corresponding to the first information acquired by the first acquisition unit. Is displayed.

According to another aspect of the present invention, in the electronic conference support device that transmits a part of the image displayed on the display surface of the display device to the user's terminal device, the terminal device and the display surface are close to each other. A detecting unit for detecting, a first acquiring unit for acquiring first information relating to a position close to the terminal device on the display surface when the detecting unit detects proximity, and a detecting unit Is acquired by the first acquisition means out of the images displayed on the display surface and the second acquisition means for acquiring the second information for specifying the terminal device. A terminal device for extracting information on an image extracted by the extracting unit based on the second information acquired by the extracting unit that extracts an image of a predetermined region based on the first information and the second acquiring unit; A transmission means for transmitting to the extraction hand Determines whether to perform extraction for the image according to the attribute of the image displayed on the display surface, and the image associated with the terminal device and the image associated with the other terminal device Only one of these images or only both images are extracted.
According to still another aspect of the present invention, in the electronic conference support device that transmits a part of the image displayed on the display surface of the display device to the user's terminal device, the terminal device and the display surface are close to each other. Detecting means for detecting the first detection means, first detection means for acquiring first information relating to a position close to the terminal device on the display surface when the detection means detects the proximity, and detection When the proximity is detected by the means, the second acquisition means for acquiring the second information for identifying the terminal device, and the first acquisition means among the images displayed on the display surface Extraction means for extracting an image of a predetermined region based on the acquired first information, and information on the image extracted by the extraction means based on the second information acquired by the second acquisition means A transmission means for transmitting to the device and a transmitter After the image is transmitted to the terminal device by the second detection means for detecting that the terminal device is close to the display surface and when the proximity is detected by the second detection means, the display is performed. Display control means for performing control to display an image based on information sent from the terminal device is provided on the surface.
Preferably, the electronic conference support apparatus further includes third acquisition means for acquiring size designation information transmitted from the terminal device when the proximity is detected by the detection means. An image of an area having a size corresponding to the size designation information acquired by the acquisition unit is extracted.
According to still another aspect of the present invention, an electronic conference system is provided between a display device having a display surface, the electronic conference support device according to any one of the above that communicates with the display device, and at least an electronic conference support device. When the terminal device and the display surface are close to each other, a part of the image displayed on the display surface is extracted by the extracting unit and transmitted to the terminal device by the transmitting unit .

  Preferably, the electronic conference support device is provided in the display device.

  Preferably, the electronic conference support device is provided in the terminal device.

  According to still another aspect of the present invention, a display device includes a display surface and the electronic conference support device according to any one of the above, and when the user's terminal device and the display surface are close to each other, the display surface A part of the image displayed on the screen is extracted by the extracting means, and the extracted image is transmitted to the terminal device by the transmitting means.

  According to still another aspect of the present invention, a terminal device includes the electronic conference support device according to any one of the above and a display unit that displays an image, and is extracted when close to the display surface of the display device. The means acquires the image displayed on the display surface, extracts a part of the acquired image, the transmission means transmits the extracted image to the display part, and the display part is transmitted by the transmission means. Displays an image.

  According to still another aspect of the present invention, an image forming apparatus includes any one of the electronic conference support apparatuses described above.

According to still another aspect of the present invention, a part of an image displayed on a display surface of a display device having a plurality of communication units is transmitted to a terminal device of a user who communicates with the plurality of communication units. The electronic conference support apparatus control method is capable of transferring information held by a terminal apparatus or information included in a display apparatus including image data related to an image between a plurality of communication units and the terminal apparatus. The control method uses a plurality of communication units to detect that the terminal device and the display surface are close to each other, and when the detection step detects that the terminal devices are close to each other , A first acquisition step for acquiring first information related to a position close to the terminal device on the display surface by grasping which one is used for communication and a detection step closer to each other Iko Is detected, the second acquisition step of acquiring the second information specifying the terminal device, and the first information acquired by the first acquisition step among the images displayed on the display surface An extraction step for extracting an image of a predetermined region based on the information, and a transmission step for transmitting information on the image extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step; Is provided.
According to still another aspect of the present invention, in a control method for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user's terminal device, the terminal device and the display surface are close to each other. And a first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when the proximity is detected by the detection step. And a second acquisition step of acquiring second information for identifying the terminal device when the proximity is detected by the detection step, and the first of the images displayed on the display surface An extraction step for extracting an image of a predetermined region based on the first information acquired by the acquisition step, and an image extracted by the extraction step based on the second information acquired by the second acquisition step A transmission step of transmitting the information to the terminal device, and the extraction step determines whether or not to extract the image according to the attribute of the image displayed on the display surface, and associates with the terminal device Extraction is performed for only one image or only both images of the displayed image and the image associated with the other terminal device.
According to still another aspect of the present invention, in a control method for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user's terminal device, the terminal device and the display surface are close to each other. And a first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when the proximity is detected by the detection step. And a second acquisition step of acquiring second information for identifying the terminal device when the proximity is detected by the detection step, and the first of the images displayed on the display surface An extraction step for extracting an image of a predetermined region based on the first information acquired by the acquisition step, and an image extracted by the extraction step based on the second information acquired by the second acquisition step A transmission step of transmitting the information to the terminal device, a second detection step of detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission step, and a second detection A display control step for performing control to display an image based on information sent from the terminal device on the display surface when proximity is detected by the step.

According to still another aspect of the present invention, a part of an image displayed on a display surface of a display device having a plurality of communication units is transmitted to a terminal device of a user who communicates with the plurality of communication units. The control program of the electronic conference support apparatus can transfer information held by the terminal device or information included in the display device including image data related to an image between the plurality of communication units and the terminal device. The control program uses a plurality of communication units to detect that the terminal device and the display surface are close to each other, and when the detection step detects that the terminal device and the display surface are close to each other , a first obtaining step of obtaining first information regarding a position in proximity to the terminal device on the display surface by grasping whether communication using any have been made, near the detection step The second acquisition step of acquiring the second information for specifying the terminal device, and the first acquisition step of the images displayed on the display surface when it is detected Based on the extraction step for extracting an image of a predetermined region based on the first information and the second information acquired by the second acquisition step, information on the image extracted by the extraction step is transmitted to the terminal device. And causing the computer to execute a transmission step.
According to still another aspect of the present invention, in a control program for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user's terminal device, the terminal device and the display surface are close to each other. And a first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when the proximity is detected by the detection step. And a second acquisition step of acquiring second information for identifying the terminal device when the proximity is detected by the detection step, and the first of the images displayed on the display surface An extraction step for extracting an image of a predetermined region based on the first information acquired in the acquisition step, and an extraction step based on the second information acquired in the second acquisition step. A transmission step of transmitting the information of the image to the terminal device to the computer, and the extraction step determines whether or not to extract the image according to the attribute of the image displayed on the display surface, Extraction is performed for only one or both of the images associated with the terminal device and the images associated with the other terminal devices.
According to still another aspect of the present invention, in a control program for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user's terminal device, the terminal device and the display surface are close to each other. And a first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when the proximity is detected by the detection step. And a second acquisition step of acquiring second information for identifying the terminal device when the proximity is detected by the detection step, and the first of the images displayed on the display surface An extraction step for extracting an image of a predetermined region based on the first information acquired in the acquisition step, and an extraction step based on the second information acquired in the second acquisition step. A transmission step for transmitting information on the image to the terminal device, a second detection step for detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission step, When the proximity is detected by the detection step, the computer is caused to execute a display control step for performing control for displaying an image based on information sent from the terminal device on the display surface.

  According to these inventions, when it is detected that the terminal device is close to the display surface, an image of an area based on the position where the terminal device is close is extracted by the extracting means and transmitted to the terminal device. . Therefore, an electronic conference support device, an electronic conference system, a display device, a terminal device, an image forming device, an electronic conference support device control method, and an electronic conference support device that can capture information on the display device into the terminal device with an easy operation A control program can be provided.

It is a block diagram which shows the structure of the electronic conference system in one of the embodiment of this invention. 1 is a perspective view showing an MFP. 2 is a block diagram illustrating a hardware configuration of an MFP. FIG. It is a block diagram which shows the hardware constitutions of a terminal device. It is a block diagram which shows the hardware constitutions of a display apparatus. It is a front view which shows schematic structure of a display apparatus. It is a front view explaining an example when a terminal device adjoins to a display device. It is a figure explaining the usage example of an acquisition function. It is a sequence diagram explaining the flow at the time of execution of a capture function. It is a sequence diagram which shows an example of the re-pasting function after execution of an acquisition function. It is a figure which shows the taking-in setting screen of a terminal device. FIG. 10 is a sequence diagram illustrating a flow of an image capturing function according to a modification when the MFP functions as an electronic conference support apparatus. FIG. 10 is a sequence diagram illustrating a flow of a re-pasting function according to a modification when the MFP functions as an electronic conference support apparatus. It is a sequence diagram which shows the flow of the image capture function which concerns on the modification when a terminal device itself functions as an electronic conference assistance apparatus. It is a sequence diagram which shows the flow of the re-pasting function which concerns on the modification in case a terminal device itself functions as an electronic conference assistance apparatus.

  Hereinafter, an electronic conference system according to one embodiment of the present invention will be described.

  The electronic conference system includes a terminal device, a display device, and an MFP (image forming apparatus) that functions as a server. Each device is connected via a network. The terminal device is connected to the network by wireless connection.

  A terminal device has touch panels, such as electronic paper and a display, for example. The terminal device includes an operation display unit that can be touch-operated (for example, a so-called multi-touch type capable of simultaneously touching a plurality of locations), a storage unit that stores an image or a document, a relatively high directivity, and a display device. It has a communication unit for detecting a position, a transfer unit capable of communicating image data and image size information with a display device, a server, and the like, and a control unit for controlling each unit.

  The display device is, for example, an electronic blackboard, a white board, or a display. The display device includes a display unit, a communication unit, a control unit that functions as a position specifying unit and a terminal specifying unit, an extraction unit, a storage unit, a transfer unit, and the like. The display unit displays an image transmitted from the terminal device, an image directly written by an electronic pen, or the like. The communication unit is embedded at many positions on the display screen. The communication unit has a relatively high directivity, and detects that the terminal device has approached (approached or contacted) with the terminal device. The position specifying unit specifies the contact position of the terminal device on the display screen. The terminal specifying unit specifies a terminal close to the display unit. The extraction unit cuts out an image of a predetermined area from the image on the display unit based on a close position (hereinafter, also referred to as a contact position). The storage unit stores image data to be displayed on the display unit, image data of a predetermined area, and the like. The transfer unit communicates image data and image size information with a terminal device and a server.

  An MFP as a server has a part for printing an image, a storage unit for storing an image or a document, a control unit, and a transfer unit for communicating image data with a terminal device or a display device. doing. The MFP has a print function for transporting a sheet or the like by a roller and printing on the sheet, a server function for storing document data or the like in a storage unit, or the like.

  In the present embodiment, for example, the display device functions as an electronic conference support device that executes a capture function. According to the capture function, the user can capture the image data in the terminal device by holding the terminal device over a desired position in the image displayed on the display unit of the display device. For example, the MFP may function as an electronic conference support device, or the terminal device may function as an electronic conference support device.

  The capture function is performed as follows. That is, when the terminal device is close to the display unit, the display device detects that the terminal device is close to the display unit. The display device specifies a position where the terminal device is close, and extracts an image displayed in a predetermined area based on the specified position (cuts out the image). Further, the display device identifies the terminal that has contacted. The extracted image is sent to the identified terminal device and taken into the terminal device.

  In an electronic conference where multiple people use a display device to collect opinions, a user who is a participant can intuitively easily extract a part of the data displayed on the display unit. it can. User operability is improved, and convenience of the electronic conference system is improved.

  In the terminal device, the size of the display image to be captured in advance may be set. At this time, the display device performs control to cut out information displayed at the specified position based on the size set by the terminal device.

  Further, the image captured by the terminal device may be limited according to the attribute of each image displayed on the display unit. For example, the image captured by the terminal device may be controlled to be limited to only images pasted by various terminal devices. At this time, an image that can be captured by a specific terminal device held by a user may be limited to an image pasted by the terminal device, or pasted by a terminal held by another user. You may make it restrict | limit to the image which was. Further, whether or not to limit the images that can be captured in this way is selected by the user or other administrator, and based on the selection result, the images that the display device transmits to the terminal device may be limited. .

  In the terminal device, when the image captured as described above is edited, the edited image is pasted on the image on the display unit by bringing the terminal device close to the display unit. Also good.

  [Embodiment]

  FIG. 1 is a block diagram showing a configuration of an electronic conference system according to one embodiment of the present invention.

  As shown in FIG. 1, the electronic conference system 11 includes a plurality of devices connected to a network 801, for example. In other words, the electronic conference system 11 includes an MFP (server; image forming apparatus) 101, a plurality of terminal devices 201, a display device 301, a plurality of PCs 401, and the like. As the plurality of terminal devices 201, for example, a first terminal device (terminal device 1) 201a, a second terminal device (terminal device 2) 201b,..., An nth terminal device (terminal device n) 201, and the like are used. It has been. Here, these are not distinguished and each is referred to as a terminal device 201. As the plurality of PCs 401, for example, a first PC (PC1) 401a, a second PC (PC2) 401b,..., An nth PC (PCn) 401 are used. Here, these are not distinguished and each is called PC401.

  The network 801 is, for example, a local information communication network (LAN). The MFP 101, the display device 301, the PC 401, and the like are each connected to the network 801 so that, for example, wired communication is possible. These devices may be connected to the network 801 so that wireless communication is possible. On the other hand, the terminal device 201 is connected to the network 801 so that wireless communication is possible. The terminal device 201 is portable and can be freely moved by the user.

  [Configuration of MFP 101]

  FIG. 2 is a perspective view showing the MFP 101. FIG. 3 is a block diagram illustrating a hardware configuration of the MFP 101.

  As shown in FIG. 2, the MFP 101 includes a paper feed cassette 103, a paper discharge tray 105, an operation panel 111, a control unit 121, a printing unit 131, and a scanner unit 141. A control unit 121 controls the operation of the MFP 101. The control unit 121, the printing unit 131, the scanner unit 141, and the like are arranged inside the casing of the MFP 101.

  The MFP 101 has three paper feed cassettes 103 (paper feed cassettes 103a, 103b, and 103c). Each paper feed cassette 103 is loaded with, for example, different sizes of paper (B5 size, A4 size, A3 size, etc.). The paper feed cassette 103 is disposed in the lower part of the MFP 101 so that it can be inserted into and removed from the housing of the MFP 101. The paper loaded in each paper feed cassette 103 is fed one by one from the paper feed cassette 103 and sent to the printing unit 131 at the time of printing. Note that the number of paper feed cassettes 103 is not limited to three and may be more or less.

  The paper discharge tray 105 is disposed above the portion of the housing of the MFP 101 where the printing unit 131 is stored and below the portion where the scanner unit 141 is disposed. The paper on which the image is formed by the printing unit 131 is discharged from the inside of the housing to the paper discharge tray 5.

  The printing unit 131 roughly includes a toner image forming unit (not shown), a paper transport unit (not shown), and a fixing device (not shown). The printing unit 131 forms an image on a sheet by, for example, electrophotography.

  The paper transport unit includes a paper feed roller, a transport solar, and a motor that drives them. The paper transport unit feeds paper from the paper feed cassette 103 and transports it inside the housing of the MFP 101. The paper transport unit discharges the paper on which the image is formed from the housing of the MFP 101 to the paper discharge tray 105 or the like.

  The fixing device has a heating roller and a pressure roller. The fixing device conveys the sheet on which the toner image is formed between the heating roller and the pressure roller, and heats and presses the sheet. As a result, the fixing device melts the toner adhering to the paper and fixes it on the paper to form an image on the paper.

  The scanner unit 141 is arranged on the upper part of the casing of the MFP 101. The scanner unit 141 includes an ADF (Auto Document Feeder) 143. The scanner unit 141 executes the above-described scanner function. The scanner unit 141 scans a document placed on a transparent document table with a contact image sensor and reads it as image data. The scanner unit 141 reads a plurality of documents set on the document tray one by one by the ADF 143 one by one and reads the document by a contact image sensor to obtain image data.

  The image read by the scanner unit 141 is converted into a finished image by the control unit 121. The control unit 121 can transmit the generated finished image to an external device or the like, or can form an image on a sheet by the printing unit 131 based on the finished image. For example, the control unit 121 can send the read image to the display device 301 and cause the display device 301 to display the read image.

  The operation panel 111 is disposed on the upper front side (front side in FIG. 2) of the MFP 101. On the operation panel 111, operation buttons that can be pressed by the user are arranged. The operation panel 111 is provided with a display unit 112 that displays information to the user.

  As illustrated in FIG. 3, the MFP 101 includes an image processing unit 123, a storage unit 125, and a transfer unit 151 in addition to the above-described units.

  The control unit 121 is connected to each unit of the MFP 101 so that signals can be transmitted and received. The control unit 121 is configured by, for example, a CPU, a ROM, a RAM, and the like. For example, a control program 121 a of the MFP 101 is stored in the ROM of the control unit 121. The control unit 121 controls various operations of the MFP 101 by executing a control program 121a and the like.

  The image processing unit 123 is controlled by the control unit 121 and executes image processing on an image read by the scanner unit 141 or an image sent from an external device.

  The storage unit 125 is, for example, an HDD (Hard Disk Drive). The storage unit 125 is called a BOX, and stores print job data sent from an external device connected to the MFP 101, image data read by the scanner unit 141, and the like. The storage unit 125 may store setting information of the MFP 101, other control programs, and the like.

  The transfer unit 151 is, for example, a network interface. The transfer unit 151 is connected to an external relay device connected to the network 801 via a LAN cable or the like. The transfer unit 151 connects the MFP 101 to the network 801.

  The display unit 112 of the operation panel 111 is a touch panel. The display unit 112 is, for example, a liquid crystal display (LCD). The display unit 112 displays a guidance screen to the user or displays an operation button to accept a touch operation from the user. When the user touches the display unit 112, the information is sent to the control unit 121, and the control unit 121 controls the operation panel 111 based on the information. That is, the user can operate the operation panel 111 by touching the display unit 112 and performing an operation.

  [Configuration of terminal device]

  FIG. 4 is a block diagram illustrating a hardware configuration of the terminal device 201.

  With reference to FIG. 4, the terminal device 201 includes an operation display unit 211, a control unit 221, a storage unit 225, a transfer unit 251, a terminal communication unit 261, and the like. In the present embodiment, the terminal device 201 is, for example, a so-called tablet-type mobile terminal. The terminal device 201 may be any portable terminal such as a mobile phone, a laptop personal computer, or a portable game machine.

  The operation display unit 211 is, for example, a liquid crystal touch panel. Based on the control by the control unit 221, various images and operation images for operating the terminal device are displayed on the operation display unit 211. The user can instruct the terminal device 201 to perform a desired operation by performing a touch operation or the like on the operation image displayed on the operation display unit 211.

  Similar to the control unit 121, the control unit 221 includes a CPU, a ROM, a RAM, and the like. The control unit 221 controls various operations of the terminal device 201 by executing a control program 221a stored in a ROM or the like.

  The storage unit 225 is, for example, a flash memory. The storage unit 225 stores various programs to be executed by the terminal device 201 and document data and image data used for each program. Note that the storage unit 225 may be, for example, an HDD.

  The transfer unit 251 is a network interface, for example. In the present embodiment, the transfer unit 251 is connected to the network 801 via a so-called wireless LAN. Thereby, the terminal device 201 can perform wireless communication with the network 801.

  For example, the terminal communication unit 261 is configured to perform inter-device communication with another communication unit using a short-range wireless communication technology. The terminal communication unit 261 performs communication with the communication unit 361 (shown in FIG. 5) on the display device 301 side when the terminal device 201 approaches the display device 301 as described later.

  [Configuration of Display Device 301]

  FIG. 5 is a block diagram illustrating a hardware configuration of the display device 301.

  With reference to FIG. 5, the display device 301 includes a display unit 311, a control unit 321, a storage unit 325, a transfer unit 351, a plurality of communication units 361, and an extraction unit 371. The display device 301 is a so-called electronic blackboard, and displays various images on the display unit 311 or reflects writing on the display unit 311 by the user.

  The display unit 311 is, for example, a screen on which an image is projected and displayed by a projector (not shown). For example, when the corresponding electronic pen or the user's finger touches the display unit 311, the display unit 311 can detect that and the position thereof.

  The control unit 321 includes a CPU, ROM, RAM, and the like. A control program 321 a is stored in the ROM of the control unit 321. The control unit 321 controls the display device 301 by executing the control program 321a.

  The storage unit 325 is, for example, a nonvolatile memory or an HDD. The storage unit 325 stores information such as images and documents displayed by the display device 311. The control unit 321 displays an image on the display unit 311 or performs other controls based on information stored in the storage unit 325 or the like. The storage unit 325 can store information to be displayed on the display unit 311 transmitted from the MFP 101 or the terminal device 201, for example.

  The transfer unit 351 is a network interface similar to the transfer unit 151 of the MFP 101, for example. The transfer unit 351 connects the display device 301 to the network 801. Accordingly, the display device 301 can communicate with the MFP 101, the terminal device 201, the PC 401, and the like via the network 801.

  As will be described later, the extraction unit 371 cuts out a predetermined region of the image displayed on the display unit 311, that is, performs extraction processing. The extraction unit 371 performs an extraction process when executing a capture function as described below.

  FIG. 6 is a front view illustrating a schematic configuration of the display device 301.

  Referring to FIG. 6, a plurality of communication units 361 are arranged in a matrix of m rows and n columns on display unit 311 of display device 301. That is, the plurality of communication units 361 are arranged in a substantially horizontal direction (for example, communication units (1, 1) to (n, 1) in the uppermost row) and m in the vertical direction (for example, Communication units (1, 1) to (1, m)) are arranged side by side. Each communication unit 361 is disposed on the back surface of the display surface of the display unit 311. That is, actually, as shown in FIG. 6, it is not exposed to the near side of the display unit 311.

  Each communication unit 361 is connected to the control unit 321. The control unit 321 can grasp which of the plurality of communication units 361 is performing communication and whether communication has been performed.

  FIG. 7 is a front view for explaining an example of a state when the terminal device 201 comes close to the display device 301.

  Each communication unit 361 performs short-range wireless communication (non-contact communication) with the terminal communication unit 261 when the terminal communication unit 261 of the terminal device 201 approaches, that is, when the terminal device 201 approaches the display unit 311. Do. Here, the terminal device 201 is close to the display unit 311 means that the terminal device 201 is in contact with the display unit 311 or the communication unit 361 and the terminal communication unit 261 can communicate with each other. The state of being close to each other.

  For example, information included in the terminal device 201 and information included in the display device 301 can be transferred between the communication unit 361 and the terminal communication unit 261. Such information includes, for example, information for identifying the terminal device 201, information for specifying each communication unit 361, and the like. Note that image data or the like may be transferable.

  As shown in FIG. 7, when the terminal device 201 comes close to the display unit 311 of the display device 301, the communication unit 361 close to the terminal communication unit 261 of the terminal device 201 and the terminal communication unit 261 can communicate. FIG. 7 illustrates an example in which the terminal device 201 is close to the third row and seventh column from the upper left among the communication units 361 of the display unit 311.

  When the terminal device 201 comes close to the display unit 311 in this way, the control unit 321 of the display device 301 determines which is the communication unit 361 that starts communication with the terminal communication unit 261, and Get information and. Accordingly, the display device 301 can determine that the terminal device 201 has approached, the type of the terminal device that has approached, the position on the display unit 311 that the terminal device 201 has approached, and the like.

  [Explanation of import function]

  Here, in the present embodiment, the display device 301 functions as an electronic conference support device that executes a capture function. The user holds the terminal device 201 over a desired position on the display unit 311 and performs an operation of bringing the terminal device 201 close to the display unit 311, whereby image data of an image displayed at the desired position is displayed on the terminal device 201. Can be imported.

  FIG. 8 is a diagram illustrating an example of using the capture function.

  FIG. 8 shows an example in which three users (conference participants) 901, 902, and 903 hold a single display device 301 for a conference. Each of the users 901, 902, and 903 holds their own terminal devices 201, 201b, and 201c in their hands. Images such as various characters and figures are displayed on the display unit 311 of the display device 301. Here, for example, it is assumed that the image displayed on the display unit 311 includes three images 951, 961, 971.

  In such a case, when the user 901 wants to capture the image 951 into his / her terminal device 201, the user 901 can do the following. That is, the user 901 sets the operation mode of the terminal device 201 to the image capture mode, and brings the terminal device 201 close to the image 951. When the display device 301 detects the proximity of the terminal device 201 on the display unit 311 and the position thereof, the display device 301 transmits the image data of the image 951 located at the site where the terminal device 201 is close to the terminal device 201 via the network 801. . The terminal device 201 receives the image data and causes the operation display unit 211 to display the image 952 based on the image data. As a result, an image 952 corresponding to the image 951 is displayed on the operation display unit 211 of the terminal device 201. The image 952 may be the image 951 displayed as it is, or the image 951 may be subjected to image processing (for example, enlarged according to the size or resolution relationship between the display unit 311 and the operation display unit 211, It may be one that has been reduced).

  The same can be done when the user 902 wants to capture the image 961 into his / her terminal device 201b or when the user 903 wants to capture the image 971 into his / her terminal device 201c. That is, the user 902 can capture and display the image 962 corresponding to the image 961 in the terminal device 201b by bringing the terminal device 201b close to the position where the image 961 is displayed. In addition, the user 903 can bring the terminal device 201c close to the position where the image 971 is displayed, thereby capturing and displaying the image 972 corresponding to the image 971 in the terminal device 201c.

  FIG. 9 is a sequence diagram for explaining the flow at the time of executing the capture function.

  The capturing function is performed between the terminal device 201 and the display device 301 that also functions as an electronic conference support device in accordance with a user operation. When it is detected that the terminal device 201 is close to the display device 301 during execution of the capturing function, the extraction unit 371 of the display device 301 extracts an image to be transmitted to the terminal device 201. Image data of the extracted image is created and sent to the terminal device 201, whereby the terminal device 201 displays an image. That is, a part of the image displayed on the display unit 311 is transmitted to the terminal device 201 and captured by the terminal device 201. In FIG. 9, the display device 301 and the extraction unit 371 are shown separately, but this is for explaining an example of operations performed in the display device 301 and the extraction unit 371 in more detail.

  As shown in FIG. 9, in the capture function, user operations are performed in the following order. That is, in step S <b> 11, the user selects the image capture mode as the operation mode of the terminal device 201, and sets the operation mode of the terminal device 201 to the image capture mode. The user can change the operation mode by performing a predetermined operation on the terminal device 201. Note that the operation mode of the terminal device 201 may be changed by the user performing a predetermined operation on the display device 301, the MFP 101, or the like.

  In step S <b> 13, the user holds the terminal device 201 over the display unit 311. At this time, the user holds the terminal device 201 over a position in the display unit 311 where the image to be captured is displayed.

  When the operation in step S <b> 13 is performed, an image is displayed on the operation display unit 211 of the terminal device 201 by performing processing between the terminal device 201 and the display device 301 as described later.

  The capture function is realized by the display device 301, the extraction unit 371 inside the display device 301, and the terminal device 201 performing the following processing as the terminal device 201 approaches the display unit 311. Has been. These processes are performed by operating each unit of the display device 301 or each unit of the terminal device 201 under the control of the control unit 321 of the display device 301 or the control unit 221 of the terminal device 201.

  Before the capturing function is started, an image is displayed on the display unit 311 of the display device 301 (step S101). The image displayed at this time may be, for example, an instruction to be displayed by each user or an image sent from the MFP 101 or the PC 401.

  When the user selects an image capture mode as described above (S11), the operation mode of the terminal device 201 becomes the image capture mode in step S103. That is, in the terminal device 201, the image capture mode starts and the capture function starts.

  When the user holds the terminal device 201 over the display unit 311 (S13), the terminal communication unit 261 and the communication unit 361 communicate in steps S105 and S106. Thereby, the terminal device 201 detects that it is approaching the display device 301 (step S107). In addition, the display device 301 detects that the terminal device 201 is in proximity.

  In step S111, the terminal device 201 transmits predetermined size designation information. The size designation information is transmitted to the extraction unit 371 of the display device 301 via the network 801. Here, the size designation information is information indicating a range in which an image is captured, for example, information for designating a range to be captured from an arbitrary reference position. That is, as will be described later, an image of an area corresponding to the size designation information is extracted and taken into the terminal device 201. The size designation information may be specified by the user when the image capture mode is selected, or may be set as a constant value. Moreover, you may acquire from another apparatus.

  In step S <b> 113, the extraction unit 371 receives the size designation information sent from the terminal device 201.

  In step S115, the extraction unit 371 acquires and stores the first information and the second information. The information is stored in the storage unit 325, for example. Here, the first information and the second are respectively as follows.

  The first information is information related to a position close to the terminal device 201 on the display unit 311. That is, the first information is information indicating a position designated on the display unit 311 when the user brings the terminal device 201 close to the first information. When any one of the terminal communication unit 261 and the plurality of communication units 361 communicates and it is detected that the terminal device 201 is close to the display unit 311, depending on which one the communication unit 361 is, First information is acquired.

  The second information is information for specifying the terminal device 201 close to the display unit 311, and is, for example, an identification number unique to each terminal device 201. When the terminal communication unit 261 communicates with the communication unit 361 and it is detected that the terminal device 201 is close to the display unit 311, the identification number of the terminal device 201 is sent to the display device 301. Thereby, 2nd information is acquired.

  After storing the first information and the second information, the extraction unit 371 determines and confirms the detection position where the terminal device 201 is detected on the display unit 311 in step S117. The detection position can be determined based on the first information.

  In step S <b> 119, the display device 301 sends image information related to the image displayed on the display unit 311 to the extraction unit 371. The image information transmitted at this time may include, for example, the position, size, attribute, and the like of each image displayed on the display unit 311. The image attributes may include, for example, information related to the data format of the image, the displayed date / time or the generated date / time, the displayed user, and the like. In addition, when a plurality of layers are displayed in a superimposed manner on the display unit 311, information regarding the layer to which the image belongs may be included as image information instead of the above-described information.

  In step S121, the extraction unit 371 acquires image information.

  In step S123, the extracting unit 371 extracts an image (transmission image) to be transmitted to the terminal device 201. The transmission image is an image selected (extracted) from the image displayed on the display unit 311, for example.

  At this time, the extraction unit 371 extracts a transmission image based on the detection position of the terminal device 201, image information, and size designation information. That is, the presence / absence of an image displayed on the display unit 311 is determined based on the image information in a predetermined area on the display unit 311 specified based on the detection position and the size designation information. If there is an image in a predetermined area, the image is extracted as a transmission image.

  Note that the extraction unit 371 can perform image extraction under various conditions according to image information. For example, the extraction unit 371 determines whether or not each image matches a predetermined condition based on the attribute of each image, and determines to extract only images that match the condition. Also good.

  In step S <b> 125, the extraction unit 371 issues a transmission instruction indicating that the extracted transmission image should be transmitted to the terminal device 201. Here, the transmission target of the transmission image is the terminal device 201 close to the display unit 311 specified based on the second information.

  When a transmission instruction is given by the extraction unit 371, in step S127, the display device 301 creates image data for the transmission image.

  In step S129, the display device 301 transmits the created image data to the terminal device 201 specified based on the second information. The transmission is performed via the network 801 by the transfer unit 351, for example.

  In step S131, the terminal device 201 receives the image data transmitted from the display device 301. Thereby, the image data is taken into the terminal device 201.

  In step S133, the terminal apparatus 201 displays an image on the operation display unit 211 based on the received image data. This completes a series of capture functions.

  [Re-paste function]

  Here, in the present embodiment, the image captured by the terminal device 201 by the capture function can be displayed (pasted) again on the display unit 311 (re-paste function). This can be performed by the user again bringing the terminal device 201 close to the display unit 311 after the image is transmitted to the terminal device 201 by the capturing function.

  The re-pasting function is executed together with the capturing function when, for example, the terminal device 201 selects the “image clipping / editing” mode (editing mode) as the processing mode related to image clipping. That is, when the editing mode is selected, when the terminal device 201 is held over the display device 301, the display image is cut out as described above and transmitted to the terminal device 201 adjacent to the display device 301. At the same time, the first information and the second information are stored. After that, when the user edits the image captured in the terminal device 201 and again holds the terminal device 201 over the peripheral position of the original image on the display unit 311, based on the stored information, the original image A location is identified. Then, the edited image (updated image) is transferred from the terminal device 201 to the display device 301, and the display device 301 displays the image at the specified position.

  FIG. 10 is a sequence diagram illustrating an example of a re-pasting function after the capture function is executed.

  FIG. 10 shows a flow of operations when an image captured by the capture function is edited and then the edited image is pasted on the display unit 311.

  That is, in S15, the user performs an editing operation on the image captured in the terminal device 201. Examples of the editing operation include operations for changing the size of the image, changing the color of the image, and adding or deleting characters or figures.

  In step S <b> 135, the terminal device 201 updates an image in accordance with an editing operation by the user.

  When the update of the image is completed, the user holds the terminal device 201 over the display unit 311 in step S17.

  When the terminal device 201 is held over the display unit 311, operations similar to steps S105 to S108 are performed in steps S137 to S140. That is, the communication unit 361 and the terminal communication unit 261 perform communication. Then, the terminal device 201 detects that the display device 311 has been approached, and the display device 301 detects that the display device 301 has approached the terminal device 201.

  In step S143, the terminal device 201 transmits the image data of the updated image. For example, the image data is transmitted via the network 801 by the transfer unit 251.

  In step S145, the display device 301 receives the image data transmitted from the terminal device 201.

  In step S147, the extraction unit 371 performs display control based on the image data received by the display device 301. For example, the extraction unit 371 identifies an image (original image) that has been extracted for transmission to the terminal device 201 last time. Then, control is performed so that the image data transmitted from the terminal device 201 is displayed instead of the original image. This control can be performed based on, for example, the stored first information or second information.

  In step S149, the display device 301 displays the updated image on the display unit 311. The display is performed based on display control of the extraction unit 371. As a result, the original image on the display unit 311 captured by the terminal device 201 by the capture function is replaced with the image updated in the terminal device 201.

  Note that the edited image is displayed when an operation is performed to bring the terminal device 201 close to a position distant from the position where the original image is displayed on the display unit 311 or when a predetermined operation mode is set. May be pasted (displayed) on the display unit 311 separately from the original image.

  [Explanation of import settings]

  In the present embodiment, the user can make settings such as how to capture an image prior to execution of the capture function (capture setting). The capture setting can be performed, for example, by performing a predetermined input operation on the terminal device 201 while displaying the capture setting screen on the operation display unit 211.

  FIG. 11 is a diagram illustrating a capture setting screen of the terminal device 201.

  The capture setting screen is, for example, a screen displayed on the operation display unit 211 when the image capture mode is selected. As shown in FIG. 11, on the capture setting screen, options for setting which type of operation mode the terminal device 201 is to be displayed are displayed. For example, handwriting, file reading, file writing, special processing, etc. can be selected.

  The user can select an image capture mode, for example, by selecting an appropriate option as shown in FIG. That is, when “special processing” is selected, options for processing in a lower category corresponding to the special processing (for example, image pasting, image clipping, image clipping editing, etc.) are displayed. Here, the “image cut and edit” mode is selected. Then, as specific processing, it is selected whether to perform cutting (capturing) or pasting. Here, cutout is selected.

  In this state, the user can set various fine operation modes such as a cutout mode and a cutout size.

  As the cutout mode, for example, normal cutout, pasted display image only, or only other terminal pasted display image can be selected. “Normal clipping” is a mode for capturing an image corresponding to the proximity position of the terminal apparatus 201, regardless of the attribute of the image. “Paste display image only” is associated with, for example, an image pasted by any one of the images corresponding to the proximity positions of the terminal device 201, that is, the terminal device 201 of any user. This mode is for capturing only images. In this mode, only the display image pasted from the terminal device 201 can be cut out, except for the image displayed when instructed by the MFP 101 or the PC 401. “Only the other terminal pasted display image” is associated with the image pasted by a user other than the user among the images corresponding to the positions near the terminal device 201, that is, the other user terminal device 201. This mode is for capturing only images. Note that a mode for capturing only an image pasted by the terminal device 201 of the user himself / herself may be selectable.

  As the cut-out size, for example, the range in which the image is cut out with respect to the reference position can be designated by a dimension (for example, a length unit or a pixel number unit). For example, using the position where the terminal device 201 is close to the display unit 311 as a reference position, an image of an area specified by the dimension specified here is extracted and sent to the terminal device 201.

  The user can easily capture a desired image into the terminal device 201 by executing the capturing function in a state where the clipping mode and the clipping size are set.

  For example, in the case where a plurality of images with different users, which are attributed to each other, are close to each other on the display unit 311, an image attributed to another user (for example, by the terminal device 201 of another user). Assume that a pasted image) is to be captured. At this time, the user selects “other terminal pasted display image only” as the setting of the cut-out mode, and performs the operation of bringing the terminal device 201 close to the position of the image, thereby easily capturing only the image to be captured. be able to. Note that which image is to be transmitted to the terminal device 201 is determined by, for example, the extraction unit 371 in step S123 of FIG. 9 described above, information regarding the attribute of each image, second information regarding the adjacent terminal device 201, and the like. Based on this, it is determined by extracting an image corresponding to the condition.

  Further, for example, when a relatively large image or a small image is displayed on the display unit 311, it is assumed that the user wants to capture the image. At this time, the user sets the cut-out size to a size corresponding to the image to be captured, and then executes the capture function. Thereby, it is possible to extract and capture an image in a desired range from a position where the terminal device 201 is close. Contrary to the intention, it is possible to prevent another image at a slightly distant position from being captured together, or the size of the image to be captured to be too large to capture the entire image. Note that when the cut-out size is set, the setting content is reflected as size designation information in the capture function executed thereafter. As a result, the image is extracted and taken into the terminal device 201 within a range corresponding to the setting content of the cutout size.

  As described above, according to the present embodiment, in the electronic conference system 11, the display device 301 functions as an electronic conference support device, and the capture function can be executed. In the capturing function, the user can intuitively and easily transmit a part of the image displayed on the display unit 311 to the terminal device 201, capture the terminal device 201, and display it on the operation display unit 211. Can do. Therefore, it is possible to realize the electronic conference system 11 with high user operability and high convenience.

  Further, according to the electronic conference system 11, the user performs an operation of simply bringing the terminal device 201 close to the display unit 311, so that the image captured in the terminal device 201 by the capture function is displayed again from the terminal device 201. It can be transmitted to the device 301 and displayed (pasted) on the display unit 311. At this time, the image to be pasted again can be displayed at the position of the original image taken in, for example, replaced with the original image, or displayed at a position different from the original image. Therefore, the user can edit and paste the captured image again with an easy operation, and the convenience of the electronic conference system 11 is further enhanced.

  It should be noted that image capture (cutout) can be performed for each unit image (for example, an image grouped into one unit or a vector-type image with a set of connections). Alternatively, an image composed of pixels that fit in a predetermined area on the display unit 311 may be simply captured as one image. For example, in a case where image data displayed on the display surface is stored in a video memory or the like of the display device, an area corresponding to a position where the terminal device 201 is close to the data stored in the video memory May be cut out and transmitted to the terminal device 201.

  In addition, when one screen displayed on the display unit 311 includes an image (layer) of a plurality of layers, the extraction unit 371 determines whether each image belongs to which layer (one aspect of the attribute) ), The image may be extracted or the original image may be specified at the time of re-pasting.

  [Modified example of device functioning as electronic conference support device]

  It is not limited to the display device 301 that plays a role as an electronic conference support device that controls the above-described capturing function and re-pasting function. For example, the MFP 101 may function as an electronic conference support device, or the terminal device 201 may function as an electronic conference support device.

  FIG. 12 is a sequence diagram illustrating a flow of an image capturing function according to a modified example when the MFP 101 functions as an electronic conference support apparatus.

  In FIG. 12, the role played by the terminal device 201 and the display device 301 is substantially the same as in FIG. 9, which shows the flow of the image capturing function, as in FIG. 12. The difference is that extraction and transmission of image data are performed. Even in this case, the operation performed by the user is the same as that shown in FIG.

  First, before execution of the image capture mode, an image is displayed on the display device 301 based on image data held by the MFP 101 as follows. That is, in step S201, the display device 301 requests the MFP 101 for image data of an image to be displayed (image data acquisition request).

  In step S203, the MFP 101 transmits image data in response to the image data acquisition request.

  In steps S205 and S207, the display apparatus 301 receives the image data sent from the MFP 101, and displays an image on the display unit 311 based on the image data. As a result, an image is displayed on the display device 301 based on the image data in the MFP 101.

  Here, when the image capture mode is selected by the user (step S11) and the terminal device 201 is held over the display unit 311 (step S13), in steps S209 to S214, the same as steps S103 to S108 in the above-described embodiment. This process is performed, and it is detected that the display device 301 and the terminal device 201 are close to each other. In step S 217, size designation information is transmitted from the terminal device 201 to the MFP 101 via the network 801.

  In steps S219 to S229, the MFP 101 performs processing in place of the extraction unit 371, and the same processing as in steps S113 to S123 is performed. In other words, the image information is transmitted from the display device 301 to the MFP 101, and the MFP 101 performs the extraction of the transmission image.

  In steps S <b> 231 and S <b> 233, the MFP 101 creates image data corresponding to the extracted transmission image, and transmits the data to the terminal device 201 close to the display unit 311.

  In steps S235 and S237, the terminal device 201 receives the image data and displays an image on the operation display unit 211 based on the received image data, as in steps S131 and S133.

  FIG. 13 is a sequence diagram illustrating a flow of a re-pasting function according to a modification when the MFP 101 functions as an electronic conference support apparatus.

  As for the re-pasting function, the MFP 101 performs some operations (for example, reception of image data and display control) performed by the display device 301 and the extraction unit 371 in the above-described embodiment. The same operation as that of the embodiment is performed. The operation performed by the user is the same as that shown in FIG.

  That is, for example, when the image is updated in the terminal device 201 (step S241) and the re-pasting function is started in response to a user operation (steps S15 and S17), the display device 301 and the terminal device are connected in steps S243 to S249. 201 is detected to be close to each other, and image data is transmitted from the terminal device 201 to the MFP 101.

  In steps S251 and S253, the MFP 101 receives the transmitted image data. Then, the image data is transmitted to the display device 301 for display on the display device 301.

  In step S255, the display device 301 receives the transmitted image data. Note that the image data transmitted in step S249 may be transmitted as it is only to the display device 301, or may be transmitted to the display device 301 and the MFP 101.

  In step S257, the MFP 101 performs display control in the same manner as the extraction unit 371 performs in the above embodiment.

  In step S 259, the display device 301 displays an image corresponding to the received image data, that is, an updated image on the display unit 311 based on display control of the MFP 101.

  FIG. 14 is a sequence diagram illustrating a flow of an image capturing function according to a modification in the case where the terminal device 201 functions as an electronic conference support device.

  Compared with the above-described embodiment, the present modification is different in that the terminal device 201 itself performs image extraction and image data transmission instead of the extraction unit 371. Even in this case, the operation performed by the user is the same as that shown in FIG. Data of an image displayed on the display unit 311 of the display device 301 is basically held in the display device 301.

  As shown in FIG. 14, the operation (steps S301 to S308) from when the image capturing function is started until it is detected that the display device 301 and the terminal device 201 are close to each other is described in the above embodiment. It is the same.

  In step S311, the terminal device 201 acquires size designation information from itself.

  In steps S313 to S331, the terminal device 201 and the display device 301 perform the same processing as steps S115 to S133 in the above-described embodiment. That is, the terminal device 201 extracts a transmission image, and the display device 301 creates and transmits image data to be sent from the display device 301 to the terminal device 201 according to the extraction result. When receiving the image data, the terminal device 201 displays an image based on the received image data.

  FIG. 15 is a sequence diagram illustrating a flow of a re-pasting function according to a modification in the case where the terminal device 201 itself functions as an electronic conference support device.

  As for the re-pasting function, the terminal device 201 performs a part of the operations performed by the display device 301 and the extraction unit 371 in the above embodiment, and the same operation as that in the above embodiment is performed. The operation performed by the user is the same as that shown in FIG.

  That is, for example, when the image is updated in the terminal device 201 (step S333) and the re-pasting function is started according to the user's operation (steps S15 and S17), the terminal device 201 and the display device are displayed in steps S335 to S341. Image data is transmitted from the terminal device 201 to the display device 301 after it is detected that the device 301 is close to each other.

  In step S343, the display device 301 receives the transmitted image data.

  In step S345, the terminal device 201 performs display control in the same manner as the extraction unit 371 performs in the above embodiment.

  In step S347, the display device 301 displays an image corresponding to the received image data, that is, an updated image on the display unit 311 based on the display control of the terminal device 201.

  [Others]

  In the above-described embodiment, the features of each part may be combined as appropriate, or some features may be omitted.

  When an image is captured by the terminal device by the capture function, the original image displayed on the display unit may remain displayed or may not be displayed.

  Whether or not the terminal device is close to the display unit of the display device and its position are not limited to those detected by short-range wireless communication. For example, by analyzing information obtained by using an optical sensor provided facing the display unit, video captured using an imaging device provided facing the display unit, etc. It may be detected whether or not the device is close to the display unit.

  Various devices constituting the electronic conference system may be connected to the network wirelessly or may be connected to the network by wire.

  The terminal communication unit and the communication unit of the display device not only detect the proximity of the display unit of the display device and the terminal device, but also realize subsequent transfer of image data and communication of other information between the two. You may do it. In this case, the terminal device may be directly connected to a device functioning as an electronic conference support device, such as a display device, without being connected to the network. At this time, a contact switch or the like may be provided on the terminal device side, and detection of the close proximity at the timing when the terminal device contacts the display unit may be performed by detecting ON / OFF of the switch together. Further, proximity and a close position may be detected based on a change in capacitance caused by the proximity of the terminal device. The display unit may be various types of touch panels, and it may be detected that the terminal device is in contact with the display unit and the position in contact with the display unit.

  The display device is not limited to a projector-type electronic blackboard. For example, a liquid crystal display or another type of display may be used.

  The processing in the above embodiment may be performed by software or by using a hardware circuit.

  A program for executing the processing in the above-described embodiment can be provided, or the program can be recorded on a recording medium such as a CD-ROM, a flexible disk, a hard disk, a ROM, a RAM, or a memory card and provided to the user. It may be. The program may be downloaded to the apparatus via a communication line such as the Internet. The processing described in the text in the above flowchart is executed by the CPU according to the program.

  The above embodiment should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

11 Electronic conference system 101 MFP (an example of a server, an image forming apparatus, and an electronic conference support apparatus)
121 Control Unit 121a Control Program 151 Transfer Unit 201 Terminal Device (Example of Electronic Conference Support Device)
211 Operation Display Unit 221 Control Unit 221a Control Program 251 Transfer Unit 261 Terminal Communication Unit 301 Display Device (Example of Electronic Conference Support Device)
311 Display (display surface)
321 Control unit 321a Control program 351 Transfer unit 361 Communication unit 371 Extraction unit 801 Network

Claims (20)

An electronic conference support device that transmits a part of an image displayed on a display surface of a display device having a plurality of communication units to a terminal device of a user that communicates with the plurality of communication units ,
Detecting means for detecting the proximity of the terminal device and the display surface using the plurality of communication units ;
When it is detected that the proximity is detected by the detection means, it is close to the terminal device on the display surface by grasping which of the plurality of communication units is used for communication. First acquisition means for acquiring first information relating to a position being present;
Second acquisition means for acquiring second information for identifying the terminal device when the detection means detects the proximity;
Extraction means for extracting an image of a predetermined region based on the first information acquired by the first acquisition means among the images displayed on the display surface;
Transmission means for transmitting information of the image extracted by the extraction means to the terminal device based on the second information acquired by the second acquisition means ;
An electronic conference support device capable of transferring information held by the terminal device or information held by the display device including image data related to the image between the plurality of communication units and the terminal device. The electronic meeting support apparatus according to claim 1 , wherein the extraction unit determines whether or not to perform the extraction on the image according to an attribute of the image displayed on the display surface. 3. The extraction unit according to claim 2 , wherein the extraction unit performs the extraction only on one or both of an image associated with the terminal device and an image associated with another terminal device. The electronic conference support apparatus described. Second detection means for detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission means;
And a display control means for performing control to display an image based on information sent from the terminal device on the display surface when the second detection means detects the proximity. Item 4. The electronic conference support apparatus according to any one of Items 1 to 3 . The display control means corresponds to the first information acquired by the first acquisition means on the display surface when the second detection means detects the proximity. The electronic conference support apparatus according to claim 4 , wherein the image is displayed at a position.   An electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user terminal device,
  Detecting means for detecting that the terminal device and the display surface are close to each other;
  First acquisition means for acquiring first information relating to a position close to the terminal device on the display surface when the detection means detects the proximity;
  Second acquisition means for acquiring second information for identifying the terminal device when the detection means detects the proximity;
  Extraction means for extracting an image of a predetermined region based on the first information acquired by the first acquisition means among the images displayed on the display surface;
  Transmission means for transmitting information of the image extracted by the extraction means to the terminal device based on the second information acquired by the second acquisition means;
  The extraction unit determines whether to perform the extraction on the image according to the attribute of the image displayed on the display surface, and determines whether the image is associated with the terminal device and other terminal devices. An electronic conference support apparatus that performs the extraction on only one or both of the associated images.   An electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user terminal device,
  Detecting means for detecting that the terminal device and the display surface are close to each other;
  First acquisition means for acquiring first information relating to a position close to the terminal device on the display surface when the detection means detects the proximity;
  Second acquisition means for acquiring second information for identifying the terminal device when the detection means detects the proximity;
  Extraction means for extracting an image of a predetermined region based on the first information acquired by the first acquisition means among the images displayed on the display surface;
  A transmission unit configured to transmit information on the image extracted by the extraction unit to the terminal device based on the second information acquired by the second acquisition unit;
  Second detection means for detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission means;
  An electronic conference comprising: display control means for performing control to display an image based on information sent from the terminal device on the display surface when the second detection means detects the proximity. Support device. When it is detected that the proximity is detected by the detection means, further comprising third acquisition means for acquiring size designation information transmitted from the terminal device,
The electronic meeting support apparatus according to claim 1, wherein the extraction unit extracts an image of an area having a size corresponding to the size designation information acquired by the third acquisition unit. A display device having a display surface;
The electronic conference support device according to any one of claims 1 to 8 , which communicates with the display device;
An electronic conference system comprising at least a terminal device that communicates with the electronic conference support device,
An electronic conference system in which when the terminal device and the display surface are close to each other, a part of an image displayed on the display surface is extracted by the extraction unit and transmitted to the terminal device by the transmission unit . The electronic conference system according to claim 9 , wherein the electronic conference support device is provided in the display device. The electronic conference system according to claim 9 , wherein the electronic conference support device is provided in the terminal device. A display surface;
An electronic conference support device according to any one of claims 1 to 8 ,
When a user's terminal device and the display surface are close to each other, a part of an image displayed on the display surface is extracted by the extraction unit, and the extracted image is transmitted to the terminal device by the transmission unit Display device. An electronic conference support device according to any one of claims 1 to 8 ,
A display unit for displaying an image,
When close to the display surface of the display device,
The extraction means acquires an image displayed on the display surface, extracts a part of the acquired image,
The transmission means transmits the extracted image to the display unit,
The terminal device, wherein the display unit displays an image transmitted by the transmission unit. An electronic conference support apparatus according to any one of claims 1 to 8, the image forming apparatus. A method for controlling an electronic conference support apparatus , wherein a part of an image displayed on a display surface of a display device having a plurality of communication units is transmitted to a terminal device of a user communicating with the plurality of communication units. And
Information that the terminal device has, or information that the display device that includes image data related to the image, can be transferred between the plurality of communication units and the terminal device,
The control method of the electronic conference support apparatus is:
A detection step of detecting that the terminal device and the display surface are close to each other using the plurality of communication units ;
When it is detected that the proximity is detected by the detection step, the proximity of the terminal device on the display surface is determined by grasping which of the plurality of communication units is used for communication. A first acquisition step of acquiring first information relating to a position being present;
A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
A control method for an electronic conference support apparatus, comprising: a transmission step of transmitting image information extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step.   A method for controlling an electronic conference support apparatus for transmitting a part of an image displayed on a display surface of a display device to a user terminal device,
  A detection step of detecting that the terminal device and the display surface are close to each other;
  A first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when it is detected that the proximity is detected by the detection step;
  A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
  An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
  A transmission step of transmitting information on the image extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step;
  The extraction step determines whether to perform the extraction on the image according to the attribute of the image displayed on the display surface, and determines whether the image is associated with the terminal device and other terminal devices. A control method for an electronic conference support apparatus, wherein the extraction is performed only on one or both of the associated images.   A method for controlling an electronic conference support apparatus for transmitting a part of an image displayed on a display surface of a display device to a user terminal device,
  A detection step of detecting that the terminal device and the display surface are close to each other;
  A first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when it is detected that the proximity is detected by the detection step;
  A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
  An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
  A transmission step of transmitting information on the image extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step;
  A second detection step of detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission step;
  An electronic conference, comprising: a display control step for performing control to display an image based on information sent from the terminal device on the display surface when the proximity is detected by the second detection step. Control method of support device. A control program for an electronic conference support apparatus that transmits a part of an image displayed on a display surface of a display device having a plurality of communication units to a terminal device of a user that communicates with the plurality of communication units. And
Information that the terminal device has, or information that the display device that includes image data related to the image, can be transferred between the plurality of communication units and the terminal device,
The control program for the electronic conference support apparatus is:
A detection step of detecting that the terminal device and the display surface are close to each other using the plurality of communication units ;
When it is detected that the proximity is detected by the detection step, the proximity of the terminal device on the display surface is determined by grasping which of the plurality of communication units is used for communication. A first acquisition step of acquiring first information relating to a position being present;
A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
An electronic conference support apparatus that causes a computer to execute a transmission step of transmitting image information extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step. Control program.   A control program for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user terminal device,
  A detection step of detecting that the terminal device and the display surface are close to each other;
  A first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when it is detected that the proximity is detected by the detection step;
  A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
  An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
  Based on the second information acquired in the second acquisition step, causing the computer to execute a transmission step of transmitting information on the image extracted in the extraction step to the terminal device,
  The extraction step determines whether to perform the extraction on the image according to the attribute of the image displayed on the display surface, and determines whether the image is associated with the terminal device and other terminal devices. A control program for an electronic conference support apparatus, which performs the extraction on only one or both of the associated images.   A control program for an electronic conference support device that transmits a part of an image displayed on a display surface of a display device to a user terminal device,
  A detection step of detecting that the terminal device and the display surface are close to each other;
  A first acquisition step of acquiring first information relating to a position close to the terminal device on the display surface when it is detected that the proximity is detected by the detection step;
  A second acquisition step of acquiring second information for specifying the terminal device when the proximity is detected by the detection step;
  An extraction step of extracting an image of a predetermined region based on the first information acquired by the first acquisition step among images displayed on the display surface;
  A transmission step of transmitting information on the image extracted by the extraction step to the terminal device based on the second information acquired by the second acquisition step;
  A second detection step of detecting that the terminal device is close to the display surface after the image is transmitted to the terminal device by the transmission step;
  Causing the computer to execute a display control step for performing control to display an image based on information sent from the terminal device on the display surface when the proximity is detected by the second detection step. Control program for electronic conference support device.

Images