JP2018117384A - Information providing apparatus and information providing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily share display data.SOLUTION: An information providing apparatus capable of communicating with an external communication terminal that communicates with at least one or more communication terminals includes: display means for displaying image data; a communication interface for transmitting the image data to the external communication terminal by wireless communication; and acquisition means for acquiring the image data when the image data displayed at the display means is transmitted to the external communication terminal by the wireless communication, during the external communication terminal executes video communication with the communication terminal. The external communication terminal executes video communication with the communication terminal prior to the communication interface that transmits the image data by the wireless communication, and the communication interface allows the external communication terminal to display the image data, as a part of video communication that is being executed with the communication terminal, when the image data is transmitted to the external communication terminal by the wireless communication.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an information providing apparatus and an information providing method.

  In recent years, communication systems that perform conferences and the like via communication networks such as the Internet have become widespread. In such a communication system, a communication terminal including a camera, a microphone, a speaker, and the like is used. When this communication terminal starts communication with another communication terminal, a video conference can be realized by transmitting and receiving imaging data (image data) and audio data acquired by the camera and microphone of each communication terminal. It is configured as follows.

  In addition, in the above communication system, in order to improve communication with the conference partner, a screen such as a presentation material displayed on the communication terminal may be transmitted / received as display data in addition to the above data. Each communication terminal that has received the display data can display the display data on the display device so that presentation materials and the like can be shared among the communication terminals.

  For example, Patent Document 1 uses the setting information of the second communication means received by the first communication means for the purpose of easily establishing wireless communication and easily processing the transmitted / received data. There is disclosed an information processing apparatus that establishes a second communication unit and transmits data of a read document to a portable terminal device via the second communication unit.

  However, in order to share document data read from the scanner, the operation procedure is many and complicated. For example, consider that a teleconference user takes paper materials distributed at an outside meeting back home and shares the materials at the remote conference. In this case, the user needs to read the paper material brought home by a network scanner connected to the in-house LAN, and store the digitized data in the portable terminal through the in-house LAN.

  However, in the conventional data transmission from the scanner to the portable terminal, the user first needs to specify the transmission destination in the scanner and then execute the reading operation. Further, in order to share the display data, the user needs to search for a place where the received data is stored in the portable terminal and then start an application software that can display the data. . As described above, there is a problem that the user has many operation procedures and is complicated in order to share the document data read from the scanner.

  The present invention has been made in view of the above, and an object thereof is to provide an information providing apparatus and an information providing method capable of easily sharing display data.

  In order to solve the above-described problems and achieve the object, an information providing apparatus according to the present invention is an information providing apparatus capable of communicating with an external communication terminal that communicates with at least one communication terminal, and displays image data. Display means for transmitting, a communication interface for transmitting image data to the external communication terminal by wireless communication, and while the external communication terminal is performing video communication with the communication terminal, the external communication terminal is wirelessly communicated with the display means. Acquisition means for acquiring image data when transmitting the displayed image data, and the external communication terminal performs video communication with the communication terminal prior to the communication interface for transmitting the image data by wireless communication When the image data is transmitted to the external communication terminal by wireless communication, the communication interface displays an image as a part of the video communication being performed with the communication terminal. Wherein the display data to the communication terminal.

  An information providing method according to the present invention is an information providing method of an information providing apparatus capable of communicating with an external communication terminal that communicates with at least one or more communication terminals, and includes a display step of displaying image data on a display unit; A communication step of transmitting image data to an external communication terminal by wireless communication, and image data displayed on the display means by wireless communication with the external communication terminal while the external communication terminal is performing video communication with the communication terminal. The external communication terminal performs video communication with the communication terminal prior to the communication step of transmitting the image data by wireless communication, and the communication step includes: When transmitting image data to an external communication terminal by wireless communication, the image data is displayed on the external communication terminal as part of the video communication being performed with the communication terminal. And characterized in that.

  According to the present invention, there is an effect that display data can be easily shared.

FIG. 1 is a diagram illustrating an example of a configuration of a transmission system according to the first embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of the transmission terminal. FIG. 3 is a diagram illustrating an example of a hardware configuration of the information providing apparatus. FIG. 4 is a diagram illustrating an example of a hardware configuration of the multifunction machine. FIG. 5 is a block diagram illustrating a functional configuration of the transmission terminal, the information providing apparatus, and the multifunction machine according to the first embodiment. FIG. 6 is a diagram illustrating an example of a management table stored in the storage unit of the transmission terminal. FIG. 7 is a diagram illustrating an example of an authentication table stored in the storage unit of the transmission terminal. FIG. 8 is a diagram for explaining a communication range of wireless communication for connecting the transmission terminal and the information providing apparatus. FIG. 9 is a diagram for explaining a communication range of wireless communication for connecting the multifunction peripheral and the information providing apparatus. FIG. 10 is an explanatory diagram showing an example of the file management table. FIG. 11 is an explanatory diagram showing an example of the data configuration of the authentication data storage unit of the multifunction machine. FIG. 12 is a diagram illustrating an example of a display screen displayed on the display of the transmission terminal. FIG. 13 is a diagram illustrating an example of a display screen displayed on the display of the transmission terminal. FIG. 14 is a diagram illustrating an example of a display screen displayed on the display of the transmission terminal. FIG. 15 is a diagram illustrating a login screen displayed when connecting to the multifunction peripheral. FIG. 16 is a diagram showing a navigation screen displayed when connecting to the multifunction machine. FIG. 17 is a flowchart illustrating a wireless communication establishment processing procedure and a data processing procedure performed by the transmission system. FIG. 18 is a flowchart illustrating a wireless communication establishment processing procedure and a data processing procedure performed by the transmission system. FIG. 19 is a diagram illustrating an example of an error screen. FIG. 20 is a diagram illustrating an example of a login screen displayed on the display of the information providing apparatus. FIG. 21 is a diagram illustrating an example of a navigation screen displayed on the display of the information providing apparatus. FIG. 22 is a diagram for explaining a processing procedure until the display data acquisition program of the transmission terminal is started by the information providing apparatus. FIG. 23 is a diagram illustrating an example of an error screen displayed on the display of the information providing apparatus. FIG. 24 is a flowchart illustrating the procedure of the display data acquisition process. FIG. 25 is a diagram illustrating an example of a file selection screen. FIG. 26A is a diagram illustrating an example of a display screen displayed on the display of the information providing apparatus. FIG. 26B is a diagram of an example of a display screen displayed on the display of the information providing apparatus. FIG. 27 is a diagram for explaining a processing procedure when display data is transmitted from the information providing apparatus. FIG. 28A is a diagram illustrating an example of a display screen displayed on the display of the information providing apparatus. FIG. 28B is a diagram illustrating an example of a display screen displayed on the display of the information providing apparatus. FIG. 29 is a diagram for explaining a processing procedure when switching the display data transmission source. FIG. 30 is a diagram for explaining a processing procedure when transmission of display data is stopped. FIG. 31 is a block diagram illustrating functional configurations of the transmission terminal, the information providing apparatus, and the multifunction machine according to the second embodiment. FIG. 32 is a diagram illustrating an example of an arrangement information management table. FIG. 33 is a diagram illustrating an example of display division and an example of an area generated by the division. FIG. 34 is a diagram illustrating an example of a relationship between arrangement information and video data or display data assigned to each of the areas 1 to 4. FIG. 35 is a state transition diagram illustrating an example of the arrangement information to be selected. FIG. 36 is a diagram illustrating an example of a correspondence between an event transmitted from the relay apparatus, display data set by the arrangement information selection unit according to the event, and a display control flag determined by the display data control unit. FIG. 37 is a diagram for explaining a transition example of the display device menu. FIG. 38 is a sequence diagram illustrating an example of a control procedure when the information providing apparatus starts transmission of display data. FIG. 39 is a diagram illustrating an example of a menu displayed on the information providing apparatus. FIG. 40 is a sequence diagram illustrating an example of a control procedure when the information providing apparatus starts transmission of display data. FIG. 41 is a flowchart illustrating an example of a procedure for determining whether or not to request distribution stop when the transmission terminal receives a “distribution start event from another”. FIG. 42 is a flowchart illustrating an example of a determination procedure of the relay device. FIG. 43 is a sequence diagram illustrating an example of a procedure in which the information providing apparatus stops the transmission of display data in the state where the process of FIG. 40 has been completed.

  Exemplary embodiments of an information providing apparatus and an information providing method will be described below in detail with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a diagram illustrating an example of a configuration of a transmission system according to the first embodiment. First, the outline of the present embodiment will be described with reference to FIG. In the present embodiment, a transmission system capable of performing a remote conference between distant locations will be described.

  The transmission system includes a data providing system for transmitting content data in one direction from one transmission terminal to the other transmission terminal via the transmission management system, information and emotions between a plurality of transmission terminals via the transmission management system, etc. A communication system that communicates with each other is included. This communication system is a system for mutually transmitting information, emotions, etc. between a plurality of communication terminals (corresponding to “transmission terminal”) via a communication management system (corresponding to “transmission management system”). Examples thereof include a conference system, a videophone system, a voice conference system, a voice phone system, and a PC (Personal Computer) screen sharing system.

  In the present embodiment, assuming a video conference system as an example of a communication system, a video conference management system as an example of a communication management system, and a video conference terminal as an example of a communication terminal, a transmission system, a transmission management system, The transmission terminal will be described. That is, the information providing apparatus and the transmission system of the present invention are not only applied to a video conference system but also applied to a communication system or a transmission system.

  A transmission system 1 shown in FIG. 1 includes a plurality of transmission terminals (10aa, 10ab, 10ba, 10bb, 10ca, 10cb, 10da, 10db) and displays for each transmission terminal (130aa, 130ab, 130ba, 130bb, 130ca, 130cb, 130da, 130db), an information providing device (30a, 30b, 30c, 30d) for providing information in cooperation with the transmission terminal, a relay device (40a, 40b, 40c, 40d), a multi-function device 80 as an image forming device, And a transmission management system 50, a router (60a, 60b, 60ab, 60c, 60d, 60cd) and a program providing system 70.

  In the present embodiment, “transmission terminal 10” is used when an arbitrary transmission terminal is indicated among the transmission terminals (10aa, 10ab...), And “an arbitrary display is indicated among the displays (130aa, 130ab...)”. When “display 130” is used to indicate any information providing device among the information providing devices, “information providing device 30” is used, and any relay device (40a, 40b, 40c, 40d) is indicated. “Relay device 40” is used, and “router 60” is used to indicate any router among the routers (60a, 60b, 60c...). In addition, the number of each terminal and apparatus shall not be limited to the example of FIG.

  The transmission terminal 10 transmits and receives conference information such as image data (imaging data and display data described later) and sound data in order to make a call with another transmission terminal 10. That is, the call in the present embodiment includes not only transmission / reception of sound data but also transmission / reception of image data.

  Here, the conference information is an item (for example, a product sample) presented to a participant of the conference, a person image of the participant, and distributed in the place of a call (remote conference) performed using the transmission terminal 10. Documents and material images that are not distributed but are displayed on the transmission terminal 10 other than the display 130 by a display device such as a projector are included. As described above, the conference information means information that can be grasped by the participant in the meeting place when the meeting is performed directly. The meeting information may be both image data and sound data, or at least one of them. For example, in the case of only image data, the attendee's voice may be represented as subtitles in the image. In the present embodiment, the case where the image of the image data is a moving image will be described. However, the image may be a still image or both a moving image and a still image may be included.

  The information providing apparatus 30 is a portable device such as a portable mobile phone, a notebook PC (Personal Computer), and a smartphone. The information providing device 30 communicates with the transmission terminal 10 and the multi-function device 80 using two kinds of communication methods having different communicable distances, and displays a screen displayed on a display 306 provided in the information providing device 30 described later. Data is transmitted (provided) to the transmission terminal 10. Here, the screen display is performed by causing the information providing apparatus 30 to execute a predetermined software program (for example, document creation software, spreadsheet software, presentation software, or the like) previously introduced into the information providing apparatus 30. Note that the screen means still image data or moving image data displayed on a display 306 described later of the information providing apparatus 30. In FIG. 1, one information providing device 30 is provided at each base (office). However, when the user (owner) of the information providing device 30 moves, it can be connected to the transmission terminal 10 at any base. Let it be possible to connect.

  A multi-function device 80 (MFP: Multi Functional Peripheral, hereinafter simply referred to as “MFP 80”) has a copy function, a scanner function, a printer function, a facsimile function, and a document box function. The multi-function device 80 of the present embodiment may be a multi-function device that does not have other functions as long as it has a scanner function and a printer function, and may also be a scanner device.

  In the present embodiment, the user places the information providing device 30 close to the multifunction device 80, instructs the multifunction device 80 to scan the document to be scanned from the information providing device 30, and instructs the multifunction device 80 to scan the document to be scanned. To scan. Then, the information providing device 30 receives the scanned document data from the multi-function device 80, stores the received data in a predetermined storage location of the information providing device 30, and associates the file name of the data with the storage location. Are registered in the file management table in the information providing apparatus 30. Then, the user brings the information providing apparatus 30 close to the transmission terminal 10, selects data to be shared from the storage location in the information providing apparatus 30, and transmits the data to the transmission terminal 10. The transmission terminal 10 shares the data in an electronic conference.

  The relay device 40 is a relay device that relays communication between the transmission terminals 10. Specifically, the relay device 40 relays conference information transmitted / received between a plurality of transmission terminals 10 to each transmission terminal 10 in a call (remote conference) performed using the transmission terminals 10. In addition, the relay device 40 changes the resolution of the image data and changes the amount of information when there is a delay in receiving conference information such as imaging data with another transmission terminal 10 that is the other party of the transmission terminal 10. Image data is transmitted to the destination transmission terminal 10. This eliminates the delay and ensures the synchronization of the conference and conference information communication. A known technique can be used as a method for changing the resolution in accordance with the delay amount.

  The transmission management system 50 manages the transmission terminal 10 and the relay device 40 in an integrated manner. Specifically, the transmission management system 50 manages the communication status of the transmission terminal 10 and the relay device 40 in an integrated manner. For example, the transmission management system 50 interacts with the transmission terminal 10 and the relay device 40 to manage registration of the transmission terminal 10 in the transmission system 1, management of the terminal ID and IP address of the transmission terminal 10, and accounting management for use. Notification of other transmission terminals 10 with which each transmission terminal 10 can communicate, grasping the usage status of each transmission terminal 10, and the like are performed. Then, the transmission management system 50 notifies the other transmission terminals 10 of the status of each transmission terminal 10 (not connected, logged in, during a meeting, etc.) as necessary.

  The router 60 is a router device for interconnecting networks, and selects an optimum route for transmitting / receiving conference information (image data and sound data).

  The program providing system 70 includes an HD (Hard Disk) (not shown) in which a transmission terminal program for realizing various functions in the transmission terminal 10 or causing the transmission terminal 10 to function as various means is stored. 10 can transmit the transmission terminal program. The HD of the program providing system 70 also stores an information providing apparatus program for causing the information providing apparatus 30 to realize various functions or to cause the information providing apparatus 30 to function as various means. The information providing apparatus program can be transmitted. In addition, the HD of the program providing system 70 also stores a relay device program for causing the relay device 40 to realize various functions or to make the relay device 40 function as various means. You can send the program. Further, the HD of the program providing system 70 also stores a call management program for realizing various functions in the transmission management system 50 or causing the transmission management system 50 to function as various means. A call management program can be transmitted.

  Further, the transmission terminals (10aa, 10ab), the relay device 40a, and the router 60a are communicably connected via the LAN 2a. The transmission terminals (10ba, 10bb), the relay device 40b, and the router 60b are communicably connected via the LAN 2b. The LAN 2a and the LAN 2b are communicably connected by a dedicated line 2ab including a router 60ab, and are constructed in a predetermined area A. For example, the region A is Japan, the LAN 2a is constructed in the Tokyo office, and the LAN 2b is constructed in the Osaka office.

  On the other hand, the transmission terminals (10ca, 10cb), the multi-function device 80, the relay device 40c, and the router 60c are communicably connected via a LAN 2c. The transmission terminals (10da, 10db), the relay device 40d, and the router 60d are connected via a LAN 2d so that they can communicate with each other. The LAN 2c and LAN 2d are communicably connected by a dedicated line 2cd including a router 60cd, and are constructed in a predetermined area B. For example, region B is the United States, LAN 2c is built in a New York office, and LAN 2d is Washington D.C. C. Is built in the office. Area A and area B are connected to each other via routers (60ab, 60cd) via the Internet 2i.

  As shown in FIG. 1, the multi-function device 80 belongs to the region B, but may be configured to belong to the region A. If it is configured to be communicable with the information providing apparatus 30, it may be configured to be installed stand-alone without being connected to the LAN 2c or the like.

  The transmission management system 50 and the program providing system 70 are communicably connected to the transmission terminal 10 and the relay device 40 via the Internet 2i. The transmission management system 50 and the program providing system 70 may be installed in the region A or the region B, or may be installed in a region other than these.

  In the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d. This communication network 2 may have a place where not only wired communication but also wireless communication is performed.

  Next, the hardware configuration of the transmission terminal 10, the information providing apparatus 30, and the multi-function device 80 described above will be described. First, the hardware configuration of the transmission terminal 10 will be described with reference to FIG.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the transmission terminal 10. As shown in the figure, the transmission terminal 10 is used as a CPU (Central Processing Unit) 101 that controls the operation of the entire transmission terminal 10, a ROM (Read Only Memory) 102 that stores various programs, and a work area for the CPU 101. A random access memory (RAM) 103, an SSD (Solid State Drive) 105 that controls the reading or writing of various data to the flash memory 104 according to the control of the CPU 101, and the reading or writing of various data to a recording medium 106 such as a memory card are controlled. Data using the media drive 107, an operation button 108 such as a cursor operated when selecting a destination of the transmission terminal 10, a power switch 109 for switching on / off the power of the transmission terminal 10, and the communication network 2. Necessary for transmission It has a network I / F110.

  Further, the transmission terminal 10 includes a first communication I / F 111 and a second communication I / F 112 as communication interfaces for transmitting and receiving various data to and from the information providing apparatus 30. Here, the first communication I / F 111 is a communication interface conforming to a wireless communication standard for non-contact IC called NFC (Near Field Communication), and the second communication I / F 112 is based on the Bluetooth (registered trademark) communication standard. It is a compliant communication interface.

  In addition, the transmission terminal 10 includes a camera 113 that captures video of parties involved in the conference and outputs video data, and a camera I / F 114 that controls driving of the camera 113 and transmits and receives image data captured by the camera 113. ing. The camera 113 incorporates an image sensor such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device image sensor (CCD) that captures an image of a subject under the control of the CPU 101 and obtains image data. The camera 113 is connected to the camera I / F 114 by a USB (Universal Serial Bus) cable or the like.

  The transmission terminal 10 also includes a sound input / output I / F 117 that processes input / output of a sound signal between the microphone 115 and the speaker 116 under the control of the CPU 101. Here, the microphone 115 and the speaker 116 are connected to the sound input / output I / F 117 by a USB cable or the like. Note that the sound to be collected by the microphone 115 is the sound around the own transmission terminal 10 (for example, the voice of the operator of the own transmission terminal 10), and the sound to be output by the speaker 116 is Sound transmitted from another transmission terminal 10 (for example, voice of an operator of the other transmission terminal 10).

  Further, the transmission terminal 10 includes a display I / F 118 that transmits image data to the display 130 under the control of the CPU 101. The display 130 is connected to the display I / F 118 by a cable 130c. The cable 130c may be an analog RGB (VGA) credit cable, a component video cable, or an HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signal. A cable may be used.

  In this embodiment, the display 130 is connected to the display I / F 118. However, the present invention is not limited to this, and it is possible to connect to a video output device including a projection device such as a projector device.

  The transmission terminal 10 also has an external device connection I / F 119 for connecting an external device. External devices such as an external camera, an external microphone, and an external speaker can be connected to the external device connection I / F 119 through a USB (Universal Serial Bus) cable or the like. When an external camera is connected, the external camera is driven in preference to the built-in camera 113 under the control of the CPU 101. Similarly, when an external microphone is connected or when an external speaker is connected, each of the external microphone and the internal speaker 116 is given priority over the internal microphone 115 and the internal speaker 116 according to the control of the CPU 101. An external speaker is driven.

  Further, the transmission terminal 10 includes a bus line 120 such as an address bus or a data bus for electrically connecting the above-described components as shown in FIG.

  Note that the recording medium 106 is detachable from the transmission terminal 10. Further, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used. The display 130 is a display unit configured by a liquid crystal or an organic EL that displays an image of a subject, an operation icon, and the like.

  The transmission terminal program executed by the transmission terminal 10 is a file in an installable or executable format, and is recorded on a computer-readable recording medium such as the recording medium 106 and distributed. Also good. Further, the transmission terminal program may be stored in the ROM 102 instead of the flash memory 104. Further, the program may be downloaded from the program providing system 70 via the network I / F 110 and recorded in the flash memory 104 or the recording medium 106.

  Next, the hardware configuration of the information providing apparatus 30 will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a hardware configuration of the information providing apparatus 30. As shown in the figure, the information providing apparatus 30 includes a CPU 301 that controls the operation of the information providing apparatus 30 as a whole, a ROM 302 that stores various programs used to drive the CPU 301, a RAM 303 that is used as a work area for the CPU 301, and information provision An HD (Hard Disk) 304 that stores various data such as device programs, an HDD (Hard Disk Drive) 305 that controls reading or writing of various data to the HD 304 in accordance with the control of the CPU 301, a cursor, a menu, a window, a character, or an image A display 306 composed of a display device such as a liquid crystal display or an organic EL display for displaying various display information, a network I / F 307 for transmitting data using the communication network 2, selection and execution of various instructions, and processing targets Select, move the cursor, etc. Operation button 308, operation panel 309 for selecting and executing various instructions using a touch panel, selection of a processing target, movement of a cursor, etc., media drive 311 for controlling reading or writing of data to a recording medium 310 such as a flash memory, external device The external device connection I / F 315 for connecting is provided.

  In addition, the information providing apparatus 30 includes a first communication I / F 312 and a second communication I / F 313 as communication interfaces for transmitting and receiving various data to and from the transmission terminal 10. Here, the first communication I / F 312 is a communication interface compliant with a wireless communication standard for non-contact ICs called NFC (Near Field Communication), and the second communication I / F 313 conforms to the Bluetooth (registered trademark) communication standard. It is a compliant communication interface.

  Various external devices can be connected to the external device connection I / F 315 by a USB cable or the like. Here, in the present embodiment, the configuration in which the information providing apparatus 30 is connected to the transmission terminal 10 by the first communication I / F 312 and the second communication I / F 313 is described as an example, but the present invention is not limited thereto. It is not something. For example, the information providing apparatus 30 may be configured to be connected to the transmission terminal 10 by a USB cable or the like through the external device connection I / F 315.

  Further, the information providing apparatus 30 includes a bus line 314 such as an address bus or a data bus for electrically connecting the above-described components as shown in FIG. The recording medium 310 is detachable from the information providing apparatus 30.

  The information providing apparatus program executed by the information providing apparatus 30 is a file in an installable format or an executable format, and is recorded on a computer-readable recording medium such as the recording medium 310 and distributed. May be. Further, the information providing apparatus program may be stored in the ROM 302 instead of the HD 304. Alternatively, the program may be downloaded from the program providing system 70 via the network I / F 307 and recorded on a computer-readable recording medium such as the HD 304 or the recording medium 310.

  The relay device 40, the transmission management system 50, and the program providing system 70 are all server devices and have the same computer configuration as the information providing device 30 described above (not shown). The CPU included in each of the relay device 40, the transmission management system 50, and the program providing system 70 executes a program stored in a storage medium included in its own device or a program provided from the program providing system 70. The functions of each device are realized.

  Next, the hardware configuration of the multi-function device 80 will be described. FIG. 4 is an explanatory diagram showing a hardware configuration of the multifunction machine according to the present embodiment. As shown in FIG. 4, the multi-function device 80 has a configuration in which a controller 510, a printer unit 81, and a scanner unit 82 are connected by a PCI (Peripheral Component Interconnect) bus. The controller 510 is a controller that controls the entire MFP 80 and controls drawing, communication, and input from the operation unit 520. The printer unit 81 or the scanner unit 82 includes an image processing part such as error diffusion for binarization and gamma conversion for gradation correction. The operation unit 520 displays an original image information and the like of a document read by the scanner unit 82 on an LCD (Liquid Crystal Display) and receives an input from the operator via the touch panel, and an operation display unit 520a from the operator. And a keyboard portion 520b that accepts key input.

  The multi-function device 80 according to the present embodiment can switch and select a document box function, a copy function, a printer function, a scanner function, and a facsimile function by using an application switching key of the operation unit 520. The document box mode is selected when the document box function is selected, the copy mode is selected when the copy function is selected, the printer mode is selected when the printer function is selected, the scanner mode is selected when the scanner function is selected, and the facsimile mode is selected when the facsimile function is selected.

  The controller 510 includes a CPU (Central Processing Unit) 511, a system memory (MEM-P) 512, a north bridge (NB) 513, a south bridge (SB) 514, and an ASIC (Application Specific Integrated). Circuit) 516, a local memory (MEM-C) 517 as a storage unit, and a hard disk drive (HDD) 518 as a storage unit, and an AGP (Accelerated Graphics Port) bus 515 between NB 513 and ASIC 516 Connected configuration. The MEM-P 512 further includes a ROM (Read Only Memory) 512a and a RAM (Random Access Memory) 512b.

  The CPU 511 performs overall control of the digital multi-function peripheral 80, has a chip set including the NB 513, the MEM-P 512, and the SB 514, and is connected to other devices via the chip set.

  The NB 513 is a bridge for connecting the CPU 511 to the MEM-P 512, the SB 514, and the AGP bus 515, and includes a memory controller that controls reading and writing of the MEM-P 512, a PCI master, and an AGP target.

  The MEM-P 512 is a system memory used as a memory for storing programs and data, a memory for developing programs and data, a memory for drawing printers, and the like, and includes a ROM 512a and a RAM 512b. The ROM 512a is a read-only memory used as a memory for storing programs and data for controlling the operation of the CPU 511, and the RAM 512b is a writable and readable memory used as a program and data development memory, a printer drawing memory, and the like. It is.

  The SB 514 is a bridge for connecting the NB 513 to a PCI device and peripheral devices. The SB 514 is connected to the NB 513 via a PCI bus, and a network interface (I / F) unit 580 and the like are also connected to the PCI bus.

  The ASIC 516 is an integrated circuit (IC) for image processing having hardware elements for image processing, and has a role of a bridge for connecting the AGP bus 515, the PCI bus, the HDD 518, and the MEM-C 517, respectively. The ASIC 516 includes a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC 516, a memory controller that controls the MEM-C 517, and a plurality of DMACs (Direct Memory) that perform rotation of image data using hardware logic. (Access Controller) and a PCI unit that transfers data between the printer unit 81 and the scanner unit 82 via the PCI bus. The ASIC 516 includes an FCU (Fax Control Unit) 530, a USB (Universal Serial Bus) 540, an IEEE 1394 (the Institute of Electrical 3rd Engineering 50th communication), an IEEE 1394 (the Institute of Electrical 3rd Engineering 50th communication), and an ASIC 516. An interface I / F 585 is connected. Here, the first communication I / F 583 is a communication interface compliant with NFC, and the second communication I / F 585 is a communication interface compliant with the Bluetooth (registered trademark) communication standard.

  The MEM-C 517 is a local memory used as an image buffer for copying and a code buffer, and the HDD 518 is a storage for storing image data, storing programs for controlling the operation of the CPU 511, storing font data, and storing forms. It is.

  The AGP bus 515 is a bus interface for a graphics accelerator card proposed for speeding up graphics processing. The AGP bus 515 speeds up the graphics accelerator card by directly accessing the MEM-P 512 with high throughput. .

  Next, functional configurations of the transmission terminal 10, the information providing apparatus 30, and the multi-function device 80 described above will be described. FIG. 5 is a block diagram illustrating functional configurations of the transmission terminal 10, the information providing apparatus 30, and the multi-function device 80 according to the first embodiment.

  As illustrated in FIG. 5, the transmission terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14, a sound input unit 15, a sound output unit 16, a display control unit 17, and a narrowing unit 18. A storage / reading processing unit 19, an external information determination unit 20, an NFC transmission / reception unit 21, and a Bluetooth transmission / reception unit 22. Each of these units is a function realized by any one of the constituent elements shown in FIG. 2 or a means to be realized by operating according to a command from the CPU 101 according to the transmission terminal program expanded in the RAM 103. is there. Further, the transmission terminal 10 has a storage unit 23 constructed by the SSD 105 shown in FIG.

  The transmission / reception unit 11 of the transmission terminal 10 is realized by a command from the CPU 101 illustrated in FIG. 2 and the network I / F 110 illustrated in FIG. 2, and various data ( Information). Further, when communication is established between the transmission / reception unit 11 and another transmission terminal 10 that is a conference partner via the relay device 40, the terminal ID of the other transmission terminal 10 is stored in the storage unit 23, which will be described later. By registering it in the management table 231 to be managed, the terminal ID of the transmission terminal 10 that has become the call partner (conference partner) is managed. The terminal ID of the transmission terminal 10 is, for example, a host name or an IP address assigned in advance to each transmission terminal 10 and is identification information that can identify each transmission terminal 10.

  The operation input receiving unit 12 is realized by a command from the CPU 101 illustrated in FIG. 2 and the operation button 108 and the power switch 109 illustrated in FIG. 2, and receives various inputs by an operator of the transmission terminal 10. For example, when the operator selects the transmission terminal 10 of the conference partner, the transmission terminal 10 used by the conference partner is displayed on the selection screen (not shown) for selecting the conference partner displayed on the display 130. When the cursor key is selected and the enter button is pressed, the terminal ID or IP address of the selected transmission terminal 10 is accepted as a conference partner. Further, in the operation input receiving unit 12, when changing the arrangement or size (layout) of the image data displayed on the screen, the operator of the own transmission terminal 10 instructs the change via the operation button 108 or the like. Accept information to do.

  The login request unit 13 is realized by a command from the CPU 101 illustrated in FIG. 2, and login request information for requesting the transmission management system 50 to log in to the transmission terminal 10 from the transmission / reception unit 11 via the communication network 2, and The current IP address of the own transmission terminal 10 is automatically transmitted. Here, it is assumed that the login request information includes at least the terminal ID, and the transmission management system 50 manages the login request information (terminal ID) and the IP address transmitted from each transmission terminal 10. It is assumed that the transmission of the login request information and the IP address to the transmission management system 50 is automatically performed when the transmission terminal 10 is turned on.

  The imaging unit 14 is realized by the instruction from the CPU 101 shown in FIG. 2, the camera 113 and the camera I / F 114 shown in FIG. 2, and takes an image of a meeting room such as an attendee who is a subject, and obtains it by this shooting. The obtained image data is output.

  The sound input unit 15 is realized by the instruction from the CPU 101 shown in FIG. 2 and the sound input / output I / F 117 shown in FIG. 2, and converts the sound near the transmission terminal 10 collected by the microphone 115 into a sound signal. Generate sound data. The sound output unit 16 is realized by a command from the CPU 101 illustrated in FIG. 2 and the sound input / output I / F 117 illustrated in FIG. 2, and outputs sound data and the like transmitted from another transmission terminal 10 to the speaker 116. Thus, sound is output from the speaker 116.

  The display control unit 17 is realized by the instruction from the CPU 101 illustrated in FIG. 2 and the display I / F 118 illustrated in FIG. 2, and transmits image data and display data to the display 130 and displays these data. Control for.

  The narrowing-down unit 18 is realized by a command from the CPU 101 illustrated in FIG. 2 and the network I / F 110 illustrated in FIG. 2, and performs a process of narrowing down from a plurality of relay devices 40 to one relay device 40. Specifically, the narrowing-down unit 18 calculates a required time (msec unit) from when the predetermined transmission information is transmitted to the relay device 40 until the response information (ACK) to the transmission information is received from the relay device 40. Then, by selecting the relay device 40 relayed in the shortest time among the required times as the relay device 40 to be used, one relay device 40 is selected from the plurality of relay devices 40.

  The storage / reading processing unit 19 is executed by the instruction from the CPU 101 shown in FIG. 2 and the SSD 105 shown in FIG. 2, and stores various data in the storage unit 23, and stores various data stored in the storage unit 23. Perform the reading process.

  The storage unit 23 includes a management table 231 (see FIG. 6) for managing the terminal ID (Identification) of the other transmission terminal 10 that is a conference partner, and authentication information for determining whether or not the information providing device 30 can be used. An authentication table 232 (see FIG. 7) storing (user ID and password) is stored. In addition, the storage unit 23 includes a display data acquisition program 233, a data transmission driver, and the like that are executed by the CPU 301 of the information providing device 30 when the storage unit 23 is mounted on the information providing device 30. It is remembered. The display data acquisition program 233 is a program for realizing the display data acquisition unit 35 in the information providing apparatus 30.

  Here, FIG. 6 is a diagram illustrating an example of the management table 231 stored in the storage unit 23. As shown in the figure, in the management table 231, the terminal ID of the transmission terminal 10 that is the conference partner is registered in association with the data number. Here, the terminal ID (transmission terminal 10aa, transmission terminal 10ba, transmission terminal 10ca) of the transmission terminal 10 of the conference partner is registered in the column for storing the terminal ID. The data number is a management number for managing each terminal ID, and is used when image data (imaging data) distributed from the transmission terminal 10 of each terminal ID is assigned to a display area to be described later.

  FIG. 7 is a diagram illustrating an example of the authentication table 232 stored in the storage unit 23. As shown in the figure, the authentication table 232 includes a column for storing a user ID (user ID column) and a column for storing a password (password column). A person ID and a password are stored in association with each other. It is assumed that authentication information consisting of a set of user ID and password is distributed in advance to authorized users of the information providing apparatus 30.

  Returning to FIG. 5, the external information determination unit 20 is realized by the CPU 101 illustrated in FIG. 2, and determines whether there is data transmission / reception from the information providing apparatus 30 outside the transmission terminal 10.

  The NFC transmission / reception unit 21 is realized by a command from the CPU 101 illustrated in FIG. 2 and the first communication I / F 111 illustrated in FIG. 2, and an NFC transmission / reception unit 31 (to be described later) of the information providing apparatus 30 by non-contact communication of the NFC standard. And non-contact communication (hereinafter referred to as NFC communication).

  Here, the NFC transmission / reception unit 21 has a shorter distance than the second communication I / F 112 (Bluetooth transmission / reception unit 22), which is another communication means, specifically, contactless wireless communication with a communication distance of about 10 cm at the maximum. To send and receive data. In the NFC standard non-contact communication by the NFC transmission / reception unit 21, the data transfer rate (maximum 424 kbps) is slower than the data transfer rate (maximum 24 Mbps) of wireless communication of the Bluetooth (registered trademark) communication standard by the Bluetooth transmission / reception unit 22. It is assumed that it is used for communication of a relatively small amount of data. Note that the NFC transmission / reception unit 21 does not have to limit the communication standard to NFC, and can perform wireless communication in a relatively short distance, that is, in a communication range narrower than the communication range of the wireless communication of the Bluetooth (registered trademark) communication standard described later. If there is a communication interface of another communication standard, the first communication I / F 111 may be used to realize a functional unit corresponding to the other communication standard.

  The NFC transmission / reception unit 21 performs NFC communication with an NFC transmission / reception unit 31 (to be described later) of the information provision device 30 when the information provision device 30 approaches the communication range of the NFC transmission / reception unit 21, and is transmitted from the NFC transmission / reception unit 31. Authentication information is received, and connection setting information necessary for establishing wireless communication of the Bluetooth (registered trademark) communication standard (hereinafter referred to as Bluetooth communication) is transmitted to the NFC transmission / reception unit 31. Here, the connection setting information is information required when wireless communication is performed by the Bluetooth transmission / reception unit 22, and includes a BD (Bluetooth Device) address, a passphrase, and the like assigned to the second communication I / F 112. included. The connection setting information may be stored in the NFC transmission / reception unit 21 or read out from the second communication I / F 112 by the NFC transmission / reception unit 21.

  The Bluetooth transmission / reception unit 22 is realized by a command from the CPU 101 illustrated in FIG. 2 and the second communication I / F 112 illustrated in FIG. 2, and the information providing device 30 according to the Bluetooth (registered trademark) communication standard that is a short-range communication unit. And communicate wirelessly. The Bluetooth transmission / reception unit 22 transmits / receives data with a large capacity (up to 24 Mbps) as compared with the NFC transmission / reception unit 21 which is a non-contact communication method of the NFC standard. Further, the Bluetooth transmission / reception unit 22 can be used at a distance between devices of about 10 to 100 m, and the communication range is expanded compared to the communication range of the NFC transmission / reception unit 21.

  Further, the Bluetooth transmission / reception unit 22 uses the connection setting information transmitted from the NFC transmission / reception unit 21 to the information providing device 30 when transmitting / receiving data to / from the information providing device 30. To establish Bluetooth communication.

  In the present embodiment, a communication I / F conforming to the Bluetooth (registered trademark) communication standard is used as the second communication I / F 112. However, the present invention is not limited to this, and other standards such as, for example, A WiFi (Wireless Fidelity) communication I / F of the IEEE802.11a / IEEE802.11b standard may be used. In this case, an IEEE802.11a / b / g / n standard network board responsible for data transmission / reception and a communication control unit (communication control) for controlling establishment of wireless communication and data transmission / reception by IEEE802.11a / b / g / n. The WiFi transmission / reception unit corresponding to the Bluetooth transmission / reception unit 22 may be configured.

  In addition, if the distance between devices is within 3 m in the UWB (Ultra Wide Band) communication method, wireless communication can be performed according to the Wireless USB standard capable of communication at 480 Mbps equivalent to the priority USB 2.0. In this case, a Wireless USB standard USB device responsible for data transmission / reception and a communication control unit (communication control program) for controlling establishment of wireless communication and data transmission / reception by the UWB communication method are equivalent to the Bluetooth transmission / reception unit 22. What is necessary is just to comprise the Wireless USB transmission / reception part to perform.

  Next, the information providing apparatus 30 will be described. As shown in FIG. 5, the information providing apparatus 30 includes an NFC transmission / reception unit 31, a Bluetooth transmission / reception unit 32, an operation input reception unit 33, a display control unit 34, a display data acquisition unit 35, a display data communication unit 36, and a storage. A read processing unit 37 and a file control unit 39 are included. Each of these units is a function realized by any one of the constituent elements shown in FIG. 3 that is operated by a command from the CPU 301 according to the information providing apparatus program expanded in the RAM 303, or a means to be functioned. It is. Further, the information providing apparatus 30 includes a storage unit 38 constructed by the HDD 305 illustrated in FIG.

  The NFC transmission / reception unit 31 is realized by a command from the CPU 301 illustrated in FIG. 3 and the first communication I / F 312 illustrated in FIG. 3. The NFC transmission / reception unit 31 performs NFC standard contactless communication (hereinafter referred to as NFC communication) of the transmission terminal 10. The NFC transmission / reception unit 21 and the NFC transmission / reception unit 85 of the multi-function device 80 communicate in a non-contact manner.

  Further, when the information providing apparatus 30 approaches the communication area of the NFC transmission / reception unit 21 of the transmission terminal 10, the NFC transmission / reception unit 31 establishes NFC communication with the NFC transmission / reception unit 21 of the transmission terminal 10, and Data (information) is transmitted and received. Specifically, when the NFC transmission / reception unit 31 establishes NFC communication with the NFC transmission / reception unit 21 of the transmission terminal 10, the NFC transmission / reception unit 31 transmits the authentication information input by the user of its own device to the transmission terminal 10, The connection setting information held by the NFC transmission / reception unit 21 of the transmission terminal 10 is received. In the present embodiment, authentication information input to the information providing apparatus 30 by the user of the information providing apparatus 30 is returned to the transmission terminal 10 serving as a communication destination, thereby authenticating the authentication information to the transmission terminal 10. Is executed.

  Similarly, the NFC transmission / reception unit 31 establishes NFC communication with the NFC transmission / reception unit 85 of the multifunction device 80 when the information providing apparatus 30 approaches the communication area of the NFC transmission / reception unit 85 of the multifunction device 80, Various data (information) is transmitted and received. Specifically, when the NFC transmission / reception unit 31 establishes NFC communication with the NFC transmission / reception unit 85 of the multi-function device 80, the authentication ID and function ID for using the multi-function device 80 from the information providing device 30, the Bluetooth transmission / reception unit Communication setting information and function setting information for establishing communication by 32 are transmitted.

  The Bluetooth transmission / reception unit 32 is realized by a command from the CPU 301 illustrated in FIG. 3 and the second communication I / F 313 illustrated in FIG. 3, and will be described later when communication with the Bluetooth transmission / reception unit 22 of the transmission terminal 10 is established. The display data acquired by the display data acquisition unit 35 is transmitted to the transmission terminal 10. Further, the Bluetooth transmission / reception unit 32 receives information indicating a display data sharing state from the transmission terminal 10. Further, the Bluetooth transmission / reception unit 32 receives image data from the multifunction device 80 when communication with the Bluetooth transmission / reception unit 86 of the multifunction device 80 is established.

  Here, FIG. 8 is a diagram for explaining a communication range of wireless communication for connecting the transmission terminal 10 and the information providing apparatus 30. FIG. 9 is a diagram for explaining a communication range of wireless communication for connecting the multi-function device 80 and the information providing apparatus 30.

  8 and 9, a communication range A11 indicated by a two-dot chain line is a communication range according to the NFC standard, that is, close proximity wireless communication capable of communication with the NFC transmission / reception unit 21 and the NFC transmission / reception unit 31, the NFC transmission / reception unit 85, and the NFC transmission / reception unit 31. Represents the communication range. Further, the communication range A12 indicated by a broken line is a communication range based on the Bluetooth (registered trademark) communication standard, that is, a short distance that enables communication with the Bluetooth transmission / reception unit 22 and the Bluetooth transmission / reception unit 32, the Bluetooth transmission / reception unit 86, and the Bluetooth transmission / reception unit 32. The wireless communication range is shown. As described above, the communication range A12 has a larger communication range than the communication range A11, and communication over a longer distance is possible.

  As described above, the NFC transmission / reception unit 21, the NFC transmission / reception unit 31, the NFC transmission / reception unit 85, and the NFC transmission / reception unit 31 automatically establish NFC communication and exchange authentication information and connection setting information when entering the communication range A11. Do. Thereafter, when the authentication information is received by the transmission terminal 10 and the multi-function device 80, the Bluetooth transmission / reception unit 22, the Bluetooth transmission / reception unit 32, the Bluetooth transmission / reception unit 86, and the Bluetooth transmission / reception unit 32 receive the connection setting information exchanged earlier. Use to establish Bluetooth communication.

  In this way, connection setting information necessary for Bluetooth communication between the transmission terminal 10 and the information providing apparatus 30 and between the multi-function device 80 and the information providing apparatus 30 is exchanged by NFC communication that allows easy data transmission and reception. In addition, the user of the information providing apparatus 30 can exchange information necessary for establishing Bluetooth communication between both apparatuses simply by bringing the information providing apparatus 30 close to the transmission terminal 10 or the multifunction device 80. Accordingly, the transmission terminal 10 and the multi-function device 80 that are communication partners can be specified without performing a special operation, and Bluetooth communication can be performed, so that convenience can be improved.

  Returning to FIG. 5, the operation input receiving unit 33 is realized by a command from the CPU 301 illustrated in FIG. 3, the operation button 308, and the operation panel 309 illustrated in FIG. 3, and receives an input by a user operation.

  The display control unit 34 is realized by the command from the CPU 301 illustrated in FIG. 3 and the display 306 illustrated in FIG. 3, and displays various information such as a cursor, menu, window, character, or image on the display 306.

  The display data acquisition unit 35 is realized by the cooperation of the CPU 301 shown in FIG. 3 and the display data acquisition program 233 stored in the storage unit 23 of the transmission terminal 10, and various types of data displayed on the display 306 by the display control unit 34. Display data related to information is acquired.

  The display data communication unit 36 is realized by the instruction from the CPU 301 shown in FIG. 3 and the second communication I / F 313 shown in FIG. 3, and the display data acquired by the display data acquisition unit 35 is transmitted to the Bluetooth transmission / reception unit 32. Via the transmission terminal 10. Further, the display data communication unit 36 receives various types of information transmitted from the transmission terminal 10 according to a change in state.

  The storage / read processing unit 37 is realized by the instruction from the CPU 301 shown in FIG. 3 and the HDD 305 shown in FIG. 3, and stores various data in the storage unit 38 or stores various data stored in the storage unit 38. A process of reading is performed. In the storage unit 38, data such as materials to be shared during the meeting (hereinafter referred to as material data), various programs (word processors, spreadsheets, presentations) and the like for displaying the material data are stored in advance. . The document data includes data scanned by the multi-function device 80 and received.

  The storage / reading processing unit 37 functions as a storage unit, and stores data scanned by the multifunction device 80 and received from the multifunction device 80 as document data in a predetermined storage location of the storage unit 38.

  The file control unit 39 functions as a control unit and stores a file management table in which a file name that is identification information of one or more data received from the multi-function device 80 is associated with a storage location where each data is stored. Generated in part 38. If the file management table has already been generated in the storage unit 38, the file name and the storage location where the data is stored are associated with each other and registered in the file management table. In the file management table, storage locations are associated with file names of one or more data.

  FIG. 10 is an explanatory diagram showing an example of the file management table. In the present embodiment, the data storage location and the file name are described by one path, and the data storage location and the file name are associated with each other. That is, in the example of “¥ cconfence ¥ doc ¥ strategy.pdf” in FIG. 10, “¥ cdconference ¥ doc ¥” is the storage location, and “strategy.pdf” is the file name.

  Returning to FIG. 5, the display control unit 34 described above displays a list of file names of one or more data registered in the file management table on the display 306, and is shared with the user via the operation input reception unit 33. Select the file name of the target data. The storage / read processing unit 37 reads the data of the file name selected by the user from the storage location registered in the file management table of the storage unit 38, and the display data communication unit 36 reads the read data from the Bluetooth transmission / reception unit. 32 to the transmission terminal 10.

  Next, the functional configuration of the multifunction device 80 will be described. The multi-function device 80 includes a scanner unit 81, a printer unit 82, a facsimile transmission / reception unit 83, a data processing unit 84, an NFC transmission / reception unit 85, a Bluetooth transmission / reception unit 86, an authentication unit 88, an availability determination unit 87, And an authentication data storage unit 89.

  The NFC transmission / reception unit 85 performs non-contact two-way communication with the information providing device 30 according to the above-described NFC wireless communication standard. Specifically, the NFC transmission / reception unit 85 does not contact the information from the NFC transmission / reception unit 31 of the information providing device 30. It has the function of a reader / writer or tag with a built-in communication control program to be read out. The NFC transmission / reception unit 85 transmits / receives data by non-contact wireless communication at a short distance, that is, a communication distance of 0 to 10 centimeters compared to the Bluetooth transmission / reception unit 86 which is another communication means. Further, in the NFC standard non-contact communication by the NFC transmission / reception unit 85, the data transfer rate (100 to 400 kbps) is slower than the data transfer rate (1 to 2 Mbps) of the Bluetooth (R) standard wireless communication by the Bluetooth transmission / reception unit 86. Used for communication of relatively small volume data. Note that the NFC transmission / reception unit 85 does not have to limit the communication standard to NFC, as long as wireless communication is possible in a relatively short distance, that is, in a communication range narrower than the communication range of the Bluetooth (R) standard described later. Other communication standards such as IrDA (Infrared Data Association) may be used.

  In addition, the NFC transmission / reception unit 85, when the information providing device 30 exists within the communication range of the NFC transmission / reception unit 85, uses the same communication protocol as the communication control program of the NFC transmission / reception unit 31 of the information providing device 30 to perform NFC of the information providing device 30. Communication with the transmission / reception unit 31 is established, and the authentication ID, function ID, communication setting information, and function setting information transmitted from the information providing apparatus 30 are received. Here, the authentication ID is authentication information for determining whether or not to permit the use of the multi-function device 80 according to an instruction from the information providing apparatus 30. The authentication ID may be unique information assigned to the information providing apparatus 30 or information for identifying a user who owns the information providing apparatus 30. When information for identifying a user is used, information such as an employee ID may be used. The function ID is function information indicating the function of the multi-function device 80 that the information providing apparatus 30 requests to use. For example, when using the print function of the multi-function device 80, “print ID” is set as the function ID. Set. When using the scanner function of the multi-function device 80, “scanner ID” is set as the function ID.

  The communication setting information is initial setting information that is necessary when wireless communication is performed by the Bluetooth transmission / reception unit 86. As described above, by receiving the communication setting information of the Bluetooth communication between the information providing apparatus 30 and the multi-function device 80 by NFC communication in which data can be easily transmitted and received, the user simply brings the information providing device 30 close to the multi-function device 80. The multifunction device 80 that is the communication partner can be specified without performing a special operation, and Bluetooth communication can be performed. Therefore, convenience is improved. The function setting information is setting information for instructing processing contents according to the function. For example, when the print ID is set as the function ID, the setting value “on” or “off” is set in the setting ID “double-sided printing” that is the print setting information as the function setting information, and the setting value “set” is set in the setting ID “aggregation”. Set “on” or “off” or the like. When the scan ID is set as the function ID, the setting value “300” dpi or the like is set as the function setting information in the setting ID “resolution” that is the scan setting information.

  The authentication unit 88 determines whether or not the authentication ID transmitted by the information providing apparatus 30 is an ID that allows the use of the multifunction device 80. Specifically, authentication is performed based on whether or not the authentication ID received by the NFC transmission / reception unit 85 matches the authentication ID stored in the authentication data storage unit 89.

  The availability determination unit 87 determines whether or not the function ID transmitted by the information providing apparatus 30 is an ID that allows the use of the multifunction device 80. Specifically, the usage permission information corresponding to the authentication ID and the function ID received by the NFC transmission / reception unit 85 is acquired from the authentication data storage unit 89, and whether or not the usage permission information is set in the acquired usage permission information. to decide.

  The Bluetooth transmission / reception unit 86 communicates with the information providing apparatus 30 in a non-contact manner according to the Bluetooth (R) standard. The Bluetooth transmission / reception unit 86 that employs the Bluetooth (R) standard wireless communication scheme transmits and receives data at a large capacity and at a higher speed (1 to 10 Mbps) than the NFC transmission / reception unit 85 of the NFC standard non-contact communication scheme. In addition, the Bluetooth transmission / reception unit 86 adopting the Bluetooth (R) standard wireless communication method can be used even if there is an obstacle as long as the distance between the devices is within 10 m, and the communication range of the communication method of the NFC standard The communication range is longer than

  Specifically, the Bluetooth transmission / reception unit 86 includes a Bluetooth (R) I / F (interface) such as a Bluetooth (R) standard transceiver that handles transmission and reception of data, and a communication control unit. The Bluetooth (R) I / F is responsible for data transmission / reception to / from the connection destination information providing apparatus 30. The communication control unit exchanges communication setting information with the communication destination via the Bluetooth (R) I / F before transmitting / receiving data to / from the information providing apparatus 30 to perform wireless communication of the Bluetooth (R) standard. It is a communication control program that performs processing to be established. As the communication setting information, unique address information assigned to the Bluetooth (R) I / F is used.

  In this embodiment, the Bluetooth transmission / reception unit 86 compliant with the Bluetooth (R) standard is used as wireless communication, but the present invention is not limited to this, and other standards, For example, the wireless communication can be performed by a so-called wireless LAN standard such as IEEE802.11a / IEEE802.11b / IEEE802.11n / IEEE802.11g. In this case, a wireless LAN is established by an IEEE802.11a / IEEE802.11b standard network board that handles data transmission and reception and a communication control unit (communication control program) that controls the establishment of wireless communication and data transmission / reception by IEEE802.11a / IEEE802.11b. What is necessary is just to comprise a communication part. Further, if the distance between devices is 3 m or less in the UWB communication method, it can be configured to perform wireless communication in accordance with the Wireless USB standard capable of communication at 480 Mbps equivalent to the wired USB 2.0. In this case, the Wireless USB communication unit may be configured by a UWB device as a Wireless USB standard that performs data transmission / reception, and a communication control unit (communication control program) that controls establishment of wireless communication and data transmission / reception.

  Also, the Bluetooth transmission / reception unit 86 receives communication setting information from the information providing apparatus 30 by NFC communication, and when Bluetooth communication with the information providing apparatus 30 is established by the received communication setting information, data corresponding to the function ID Send and receive. The data to be transmitted / received may be any of image data, document data, text data, and various other types of data.

  The scanner unit 81 reads a document with an image pickup device such as a CCD (Charge Coupled Devices). The scanner unit 81 may be equipped with an automatic document feeding function by mounting an ADF (Auto Document Feeder).

  The data processing unit 84 performs processing corresponding to the function ID and function setting conditions received by the NFC transmission / reception unit 85 on the data received by the Bluetooth transmission / reception unit 86 or the data transmitted by the Bluetooth transmission / reception unit 86. For example, when the function ID is “print ID”, image processing such as density and color adjustment and layout processing such as single-sided / double-sided printing are performed on the data according to the function setting information. When the function ID is “scanner ID”, image processing, layout processing, and the like are performed on the data read from the scanner unit 81 according to the function setting conditions.

  The printer unit 82 prints data that has been subjected to image processing, layout processing, and the like by the data processing unit 84.

  The facsimile transmission / reception unit 83 transmits the data read by the scanner unit 81 and the data transmitted from the information providing device 30 to other multifunction devices, facsimile devices, client terminals, and the like via the network. Further, the facsimile transmission / reception unit 83 receives data transmitted from other multi-function peripherals, facsimile machines, and client terminals.

  The authentication data storage unit 89 stores authentication data for determining whether or not the function of the multi-function device 80 can be used. FIG. 11 is an explanatory diagram showing an example of the data configuration of the authentication data storage unit 89. The authentication data storage unit 89 stores an authentication ID and usage permission information for each function ID in association with each other. As shown in FIG. 11, the authentication ID “person1” can use both the printer function and the scanner function of the multi-function device 80. The authentication ID “person2” can use the scanner function of the multi-function device 80, but cannot use the print function.

  Next, data displayed on the display 130 of the transmission terminal 10 of the transmission system 1 described above will be described. The data displayed on the display 130 of the transmission terminal 10 in the remote conference place includes image data captured by the camera 113 and display data transmitted from the information providing device 30 (information scanned by the multifunction device 80 and information). Including data stored in the providing device 30). Here, the imaging data means image data captured by the cameras 113 of the self and other transmission terminals 10. The display data represents a screen displayed on the display 306 of the information providing apparatus 30.

  FIG. 12 is a diagram illustrating an example of a display screen displayed on the display 130 of the transmission terminal 10. The figure shows an example in which one screen is divided into four areas. A large area (first display area) from the left to the center of the screen is a display area A21, and a small area from the upper right to the lower right of the screen (first area). The second display area is designated as display area A22 to display area A24. In the case of the screen configuration of FIG. 12, for example, imaging data of the transmission terminal 10 in which a conference participant is speaking toward the microphone 115 is assigned to the display area A21. Hereinafter, this process will be described.

  First, the CPU 101 of each transmission terminal 10 detects the speech section of the operator of the own transmission terminal 10 input via the sound input unit 15, and when this section is detected, The terminal ID is transmitted to another transmission terminal 10 via the relay device 40. When each transmission terminal 10 receives this terminal ID, the display control unit 17 of each transmission terminal 10 refers to the management table 231 shown in FIG. 5 and identifies a data number that matches this terminal ID. And the display control part 17 allocates and displays the imaging data received from the transmission terminal 10 of terminal ID matched with the specified data number to display area A21. Further, the display control unit 17 displays the imaging data received from the transmission terminal 10 having the terminal ID associated with the other data number in order from the display area A22. As a result, the imaging data of the transmission terminal 10 that is currently speaking is arranged at a position close to the center of the display screen and displayed larger than the others, so that the visibility of the participant who is speaking is improved and emphasized. Can be displayed. The order of assigning the data numbers to the display areas A22 to A24 is not particularly limited, and for example, the data numbers may be sorted in ascending order or descending order.

  When the display data is transmitted from the information providing device 30, the display control unit 17 assigns the display data to the display area A21 and displays it as A25, as shown in FIG. Ten imaging data are assigned and displayed in order from the display area A22. As a result, the display data is arranged at a position close to the center of the display screen and is displayed larger than the others, so that the visibility of presentation materials and the like can be improved and displayed with emphasis.

  Further, the display example described above may be modified as follows. When display data is transmitted from the information providing device 30, as shown in FIG. 14, the display data is displayed on the entire screen by allocating the display data to the entire screen (display area A2). Then, when a predetermined button (for example, a cursor key) of the transmission terminal 10 is pressed by the user and the input of the predetermined button is received by the operation input receiving unit 12, the display control unit 17 switches to the screen of FIG. Thereafter, every time the user presses a predetermined button, the display screen is cycled and switched as shown in FIG. 13 → FIG. 14 → FIG. With this form, even when the document data is displayed, it is possible to confirm the imaging data transmitted from the other transmission terminal 10, that is, the person at the other base according to the situation.

  Next, in the transmission system 1 configured as described above, a process in which the information providing apparatus 30 instructs the multifunction device 80 to form an image and the information providing apparatus 30 acquires data from the multifunction device 80 will be described. .

  First, a user who is a participant in a conference starts connection between the information processing apparatus 30 and the multifunction device 80 and instructs the multifunction device 80 to form an image (scan or print). Specifically, the display control unit 34 of the information providing apparatus 30 displays a login screen shown in FIG. The user inputs an authentication ID and a function ID indicating an image formation instruction on the login screen. FIG. 15 shows an example in which a scanner ID is input as a function ID, and an instruction to scan a set original is given as an image formation instruction to the multifunction device 80.

  When an authentication ID, function ID, and OK are input from the user on the login screen, the operation input receiving unit 33 receives the input. Then, the user brings the information providing apparatus 30 close to or in contact with the multi-function device 80 and executes NFC communication. Here, when the operation input receiving unit 33 receives an input, the display control unit 34 displays the navigation screen illustrated in FIG. 16 on the display 306 and instructs the user to contact the information providing apparatus 30. In this navigation screen, a file name assigned to data received from the multi-function device 80 is also input. Note that the navigation screen may not be displayed.

  Then, wireless communication establishment and data processing are performed as follows. 17 and 18 are flowcharts showing the wireless communication establishment processing procedure and the data processing procedure performed by the information providing apparatus 30 and the multi-function device 80.

  First, in the information providing apparatus 30, the NFC transmission / reception unit 31 determines whether communication with the NFC transmission / reception unit 85 of the multi-function device 80 has been established (step S301). If it is determined that communication with the NFC transmission / reception unit 85 of the multi-function device 80 has not been established, that is, the information providing device 30 does not exist within the communication range (step S301: No), the process returns to step S301, and the NFC of the multi-function device 80 Repeat until communication with the transceiver 85 is established.

  Similarly, in the multi-function device 80, the NFC transmission / reception unit 85 determines whether communication with the NFC transmission / reception unit 31 of the information providing apparatus 30 has been established (step S302). When it is determined that communication with the NFC transmission / reception unit 31 of the information providing apparatus 30 has not been established, that is, the information providing apparatus 30 does not exist within the communication range (step S302: No), the process returns to step S302, and the information providing apparatus 30 Repeat until communication with the NFC transmission / reception unit 31 is established.

  Next, when communication with the NFC transmission / reception unit 31 of the information providing device 30 is established, that is, when it is determined that the information providing device 30 is within the communication range of the multi-function device 80 (step S301: Yes), the NFC transmission / reception unit 31 The authentication ID, function ID, and function setting information are transmitted to the NFC transmission / reception unit 85 of the multi-function device 80 (step S303).

  Here, the case where the information providing device 30 is within the communication range is a case where the user touches the NFC transmission / reception unit 31 of the information provision device 30 and the NFC transmission / reception unit 85 of the multi-function device 80, and is used by the user. It is possible to reliably indicate the multifunction device 80 to be used.

  In the multi-function device 80, when it is determined that communication with the NFC transmission / reception unit 31 of the information providing device 30 has been established, that is, the information providing device 30 is within the communication range (step S302: Yes), the NFC transmission / reception unit 85 provides the information. The authentication ID, function ID, and function setting information transmitted from the NFC transmission / reception unit 31 of the device 30 are received (step S304). The authentication unit 88 acquires an authentication ID from the authentication data storage unit 89 (step S305). The NFC transmission / reception unit 85 transmits the authentication ID acquired from the authentication data storage unit 89 to the information providing apparatus 30 (step S306). The authentication unit 88 collates the authentication ID acquired from the authentication data storage unit 89 with the authentication ID transmitted from the information providing apparatus 30, and determines whether to authenticate the use of the multi-function device 80 (step S307). When it is determined that the use of the multi-function device 80 is not authenticated, that is, the received authentication ID is not stored in the authentication data storage unit 89 (step S307: No), the process is terminated.

  In the information providing apparatus 30, the NFC transmission / reception unit 31 receives the authentication ID transmitted from the multi-function device 80 (step S308). The NFC transmission / reception unit 31 determines whether to authenticate the use of the multi-function device 80 based on the received authentication ID (step S309). If it is determined that the use of the multi-function device 80 is authenticated based on the received authentication ID (step S309: Yes), the processing is continued. If it is determined that the use of the multi-function device 80 is not authenticated based on the received authentication ID (step S309: No), the display control unit 34 displays the error screen shown in FIG. 19 on the display 306 and ends the process.

  When the multifunction device 80 authenticates the use of the multifunction device 80, that is, when it is determined that the received authentication ID is stored in the authentication data storage unit 89 (step S307: Yes), the availability determination unit 87 provides information. The availability information corresponding to the authentication ID and function ID received from the device 30 is acquired from the authentication data storage unit 89 (step S310). The NFC transmission / reception unit 85 transmits the availability information acquired from the authentication data storage unit 89 to the information providing apparatus 30 (step S311). The availability determination unit 87 determines whether or not the function specified by the acquired availability information is available (step S312). If it is determined that the designated function is not available (step S312: No), the process ends.

  In the information providing apparatus 30, the NFC transmission / reception unit 31 receives the availability information transmitted from the multifunction device 80 (step S313). The NFC transmission / reception unit 31 determines whether the function of the multi-function device 80 is available based on the received availability information (step S314). If it is determined that the function of the multifunction device 80 can be used (step S314: Yes), the processing is continued. If it is determined that the function of the multi-function device 80 is not available (step S314: No), the process is terminated.

  If the MFP 80 determines that the specified function is available (step S312: Yes), the NFC transmission / reception unit 85 exchanges communication setting information with the information providing device 30 (steps S315 and S316). ). Specifically, the NFC transmission / reception unit 85 of the multifunction device 80 requests the information providing device 30 to transmit communication setting information, and the NFC transmission / reception unit 31 of the information providing device 30 transmits communication setting information for Bluetooth communication. Note that the communication setting information for Bluetooth communication may be transmitted together with the authentication ID, function ID, and function setting information in steps S303 and S304.

  In the information providing apparatus 30, the Bluetooth transmission / reception unit 32 determines whether communication with the Bluetooth transmission / reception unit 86 of the multi-function device 80 has been established (step S317). If it is determined that communication with the Bluetooth transmission / reception unit 86 of the multi-function device 80 has not been established (step S317: No), the process ends. When it is determined that communication with the Bluetooth transceiver unit 86 of the multi-function device 80 has been established (step S317: Yes), the use function is determined (step S318). If it is determined that the use function is a printer (step S318: printer), the data stored in the storage unit 38 is transmitted to the multi-function device 80 (step S319).

  On the other hand, in the multi-function device 80, the Bluetooth transmission / reception unit 86 determines whether or not communication with the Bluetooth transmission / reception unit 32 of the information providing apparatus 30 has been established (step S320). If it is determined that communication with the Bluetooth transmission / reception unit 32 of the information providing apparatus 30 has not been established (step S320: No), the process is terminated.

  When it is determined that communication with the Bluetooth transmission / reception unit 32 of the information providing apparatus 30 has been established (step S320: Yes), the availability determination unit 87 determines the usage function (step S321). When it is determined that the use function is a printer, that is, the function ID is a printer ID (step S321: printer), the Bluetooth transmission / reception unit 86 receives data transmitted from the information providing device 30 (step S322). Here, the received data is data before being processed according to the print setting information. When the information providing apparatus 30 has a data processing function, the processed data may be received and the received data may be printed. Further, data processing corresponding to a part of the print setting information may be performed on the information providing apparatus 30 side, and the remaining data processing may be performed on the multi-function device 80 side in accordance with the print setting information transmitted from the information providing apparatus 30. The data processing unit 106 processes the received data for printing according to the print setting information (step S323). The print setting information may be performed by a printer driver, or the print setting information may be embedded in the data in each description language format such as PDF (Portable Document Format) or PostScript. The printer unit 82 prints the processed data (step S324).

  If it is determined in step S321 that the function to be used is a scanner, that is, the function ID is a scanner ID (step S321: scanner), the scanner unit 81 reads an original (step S325). The data processing unit 106 processes the data read according to the scanner setting information (step S326). The Bluetooth transmission / reception unit 86 transmits the processed data to the information providing apparatus 30 (step S327).

  In the information providing apparatus 30, the Bluetooth transmission / reception unit 32 receives the data transmitted from the Bluetooth transmission / reception unit 86 of the multi-function device 80 (step S328). When the data is received, the file control unit 39 assigns the file name input on the navigation screen of FIG. 16 to the received data (step S329).

  Here, when the navigation screen shown in FIG. 16 is not displayed, or when the file name is not input on the navigation screen, the file control unit 39 acquires the date and time, and from the date and time Generate a file name. For example, if it is 10:10:30 on September 1, 2011, the file control unit 39 generates the file name as “20110901101030.pdf”. The file name is an example, and the present invention is not limited to this.

  Next, the storage / reading processing unit 37 stores the data with the file name in a predetermined storage location in the storage unit 38 (step S330). Then, as shown in FIG. 10, the file control unit 39 associates the complement location with the file name and registers them in the file management table (step S331).

  As described above, the information providing apparatus 30 can scan the original set on the multi-function device 80 and receive the scanned data simply by instructing scanning in the vicinity of the multi-function device 80.

  In addition, since the information providing apparatus 30 and the multi-function device 80 can transmit communication setting information necessary for Bluetooth communication by NFC communication and can establish Bluetooth communication using the transmitted communication setting information, the information providing apparatus 30 Communication with the multi-function device 80 can be easily performed simply by bringing the multi-function device 80 closer. In addition, by transmitting an instruction of a function to be used in the multi-function device 80 from the information providing apparatus 30 by NFC communication, the function of the multi-function device 80 is used without operating the data transmission / reception or setting for data on the multi-function device 80 side. Therefore, the work burden on the user can be reduced.

  The function setting information is also transmitted from the information providing apparatus 30 to the multi-function device 80, the original is read by the scanner unit 81 of the multi-function device 80, and data processing is performed on the read data according to the function setting information to other multi-function devices and facsimiles. You may make it transmit to an apparatus.

  Next, an operation when the information providing apparatus 30 is connected to the transmission terminal 10 connected to another transmission terminal 10 will be described.

  First, in the information providing apparatus 30, when a predetermined operation for starting use of its own apparatus is received by the operation input receiving unit 33, the display control unit 34 displays a login screen as shown in FIG. 20 on the display 306. . Here, the area A31 and the area A32 are areas for inputting authentication information (user ID, password). Although a detailed processing flow will be described later, the authentication information registered in the authentication table 232 of the transmission terminal 10 connected to the information providing apparatus 30 is input to the area A31 and the area A32, thereby providing the information. The function of the display data acquisition unit 35 of the device 30 is configured to be usable.

  The OK button B11 is a button for instructing the CPU 301 (operation input receiving unit 33) of the information providing apparatus 30 to notify the authentication information input in the area A31 and the area A32. The clear button B12 is a button for instructing clearing of the authentication information input to the areas A31 and A32. When the clear button B12 is pressed, the display control unit 34 inputs the information to the areas A31 and A32. Authentication information is cleared.

  When the user of the information providing apparatus 30 inputs authentication information to the area A31 and the area A32 via the operation button 308 or the operation panel 309 of the information providing apparatus 30, and then presses the OK button B11, the operation input is accepted. The unit 33 receives the input authentication information. Further, in response to the pressing of the OK button B11, the display control unit 34 displays on the display 306 a navigation screen for guiding the operation procedure as shown in FIG. In the navigation screen of FIG. 21, the information providing apparatus 30 is brought into contact with the transmission terminal 10, that is, the execution of NFC communication between the transmission terminal 10 and the information providing apparatus 30 is prompted.

  When the user contacts (closes) the information providing device 30 to the transmission terminal 10 according to the navigation screen, the NFC transmission / reception unit 31 (first communication I / F 312) of the information provision device 30 and the NFC transmission / reception unit 21 ( NFC communication is established with the first communication I / F 111). Further, the display control unit 34 clears the screen of FIG. 21 from the display 306 with the establishment of NFC communication.

  The Bluetooth transmission / reception unit 32 of the information providing device 30 communicates with the Bluetooth transmission / reception unit 22 of the transmission terminal 10 using the connection setting information of the transmission terminal 10 obtained by NFC communication, and mounts the storage unit 23 of the transmission terminal 10 I do. When the CPU 301 of the information providing device 30 successfully mounts the storage unit 23, the display data acquisition unit 35 is realized by executing the display data acquisition program 233 stored in the storage unit 23. Hereinafter, with reference to FIG. 22, a processing procedure until the display data acquisition program 233 of the transmission terminal 10 is activated by the information providing apparatus 30 will be described.

  FIG. 22 is a diagram for explaining a processing procedure until the display data acquisition program 233 of the transmission terminal 10 is activated by the information providing apparatus 30. First, when NFC communication is established between the information providing apparatus 30 and the transmission terminal 10, the NFC transmission / reception unit 31 of the information providing apparatus 30 receives the above-described authentication information received from the user by the operation input receiving unit 33. Then, the data is transmitted to the NFC transmitter / receiver 21 of the transmission terminal 10 (step S11).

  On the other hand, in the transmission terminal 10, when the NFC transmission / reception unit 21 receives the authentication information, the external information determination unit 20 refers to the authentication table 232 stored in the storage unit 23 and authenticates the authentication information received by the NFC transmission / reception unit 21 ( (Verification) is performed (step S12). Specifically, the external information determination unit 20 of the transmission terminal 10 includes the user ID included in the authentication information received from the information providing apparatus 30 in the user ID column of the authentication table 232, and the user ID column. It is determined whether or not the password stored in the password field of the bank matches the password included in the authentication information. If it is determined that they match, the NFC transmission / reception unit 21 transmits an OK signal indicating that the authentication is accepted from the NFC transmission / reception unit 21 of the transmission terminal 10 to the NFC transmission / reception unit 31 of the information providing device 30 (step S13).

  Note that, as a result of authentication by the external information determination unit 20, if the match with the user ID and password registered in the authentication table 232 cannot be confirmed, the NFC transmission / reception unit 21 selects the NFC transmission / reception unit of the transmission terminal 10. 21 transmits an NG signal indicating that authentication has been rejected to the NFC transmission / reception unit 31 of the information providing apparatus 30. In the information providing apparatus 30 that has received this NG signal, the display control unit 34 displays an error screen as shown in FIG. 23 and ends the process.

  When the NFC transmission / reception unit 31 of the information providing device 30 receives an OK signal from the NFC transmission / reception unit 21 of the transmission terminal 10, the connection setting information held by the NFC transmission / reception unit 21, that is, the second communication I / F 112 necessary for Bluetooth communication. The connection setting information of (Bluetooth transmission / reception unit 22) is read (step S14).

  Next, the Bluetooth transmission / reception unit 32 of the information providing device 30 performs connection setting for Bluetooth (registered trademark) communication using the connection setting information read by the NFC transmission / reception unit 31 in step S14 (step S15). In response to this connection setting, the Bluetooth transmission / reception unit 22 of the transmission terminal 10 starts a connection with the Bluetooth transmission / reception unit 32 and transmits an OK signal to the Bluetooth transmission / reception unit 32 if the connection result is successful. Further, the Bluetooth transmission / reception unit 22 of the transmission terminal 10 transmits an NG signal to the Bluetooth transmission / reception unit 32 if the connection result is unsuccessful.

  In the information providing device 30, when the Bluetooth transmission / reception unit 32 determines that Bluetooth (registered trademark) communication is possible, that is, when the OK signal is received from the Bluetooth transmission / reception unit 22, the display data communication unit 36 and the Bluetooth transmission / reception unit 32 The storage unit 23 of the transmission terminal 10 is accessed via the unit 22, and the storage unit 23 is mounted on the file system of the information providing apparatus 30 (step S16). If the connection result from the Bluetooth transmission / reception unit 22 is an NG signal, the display control unit 34 of the information providing device 30 displays an error screen as shown in FIG. 23 and ends the process.

  When the mounting of the storage unit 23 is completed, the display data communication unit 36 of the information providing device 30 accesses the file of the display data acquisition program 233 stored in the storage unit 23 and executes the display data acquisition program 233 ( Step S17). When the display data acquisition program 233 is executed, a function as the display data acquisition unit 35 is realized on the information providing apparatus 30 side, and display data displayed by the display control unit 34 of the information providing apparatus 30 can be acquired. Become.

  Here, the detail of the display data acquisition process by the information provision apparatus 30 is demonstrated. FIG. 24 is a flowchart illustrating the procedure of the display data acquisition process. First, the storage / reading unit 37 of the information providing apparatus 30 reads the file management table from the storage unit 38 (step S2301). Then, the display control unit 34 displays a file selection screen on the display 306 (step S2302). Next, the display control unit 34 displays all file names registered in the file management table on the file selection screen (step S2303). Thereafter, the information providing apparatus 30 enters a waiting state for accepting file selection from the user (step S2304: No).

  FIG. 25 is a schematic diagram illustrating an example of a file selection screen on which a file name list is displayed. As shown in FIG. 25, on the file selection screen, a list of file names registered in the file management table shown in FIG. 10 is displayed so as to be selectable by the user. Here, the storage location is not displayed on the file selection screen.

  When the file name selection from the file selection screen is received from the user (step S2304: Yes), the file control unit 39 selects from the storage location of the storage unit 38 via the storage / readout unit 37. Data of the file name thus obtained is acquired (step S2305).

  In the above example, as shown in the login screen of FIG. 20, the authentication information is manually input by the user of the information providing apparatus 30, but NFC transmission / reception is performed at a stage such as when the information providing apparatus 30 is shipped. By storing the authentication information in a storage medium that can be referred to by the unit 31 in advance, the authentication information input by the user may be omitted. The procedure in this case may be performed by omitting the process related to the display of the login screen described above.

  As described above, authentication is performed when the information providing device 30 and the transmission terminal 10 are connected, and if the authentication result is rejection, the function of the display data acquisition unit 35 is not realized, and display data is inadvertent. Can be prevented from being transmitted to the transmission terminal 10 and leakage when the display data is confidential information can be prevented. When the information providing device 30 and the transmission terminal 10 are connected, the display data communication unit 36 of the information providing device 30 mounts the storage unit 23 of the transmission terminal 10 and executes the display data acquisition program 233. This eliminates the need to install the program in the information providing apparatus 30 in advance, thereby reducing the user's burden related to the preparation of the conference. In addition, the capacity of the storage unit 38 of the information providing apparatus 30 can be saved. Furthermore, the data scanned by the multi-function device 80 can be easily shared by the transmission terminal 10.

  Next, with reference to FIG. 26 and FIG. 27, processing when the display data displayed on the information providing apparatus 30 is transmitted to the transmission terminal 10 will be described. As shown in FIG. 26A or FIG. 26B, the display data acquisition unit 35 of the information providing device 30 realized in the information providing device 30 by executing the display data acquisition program 233 instructs the start of display data transmission. As an operation input means, a start button B31 is displayed on the display 306. Here, FIG. 26A and FIG. 26B are diagrams illustrating display screens displayed on the display 306 of the information providing apparatus 30, and examples in which different display contents (display data) are displayed. Yes.

  When the display data acquisition unit 35 detects the pressing of the start button B31 via the operation input reception unit 33, the display data acquisition unit 35 acquires the display data of the screen displayed on the display 306, and uses the display data communication unit 36 to transmit the transmission terminal 10. To send to. The start button B31 displayed on the display 306 is preferably not included in the display data. Hereinafter, processing when display data is transmitted from the information providing apparatus 30 will be described.

  FIG. 27 is a diagram for explaining a processing procedure when display data is transmitted from the information providing apparatus 30. In the figure, in order to avoid complicated description, an example in which two information providing devices 30 (30a, 30c) and two transmission terminals 10 (10aa, 10ca) are provided is shown. Three or more may be used. Further, in this processing, a case will be described in which the display data of the information providing apparatus 30 that can be displayed (sharable) by each transmission terminal 10 is limited to one. In addition, it is assumed that Bluetooth communication is established in each set of the information providing apparatus 30a and the transmission terminal 10aa, the information providing apparatus 30c, and the transmission terminal 10ca.

  Further, the external information determination unit 20 of each transmission terminal 10 stores a reception flag for holding the reception state of display data notified from the relay device 40 in the RAM 103 or the like. This reception flag stores whether display data is currently being transmitted from the information providing device 30, and is true (with transmission) or false (without transmission) depending on whether or not display data is received. Remember. Note that the initial value of the reception flag is false.

  Hereinafter, an example in which display data is transmitted from the information providing apparatus 30a will be described. When the operation input receiving unit 33 of the information providing device 30a receives a pressing input of the start button (start button B31 or the like) instructing the start of transmission of the display data described above (step S21), the display data acquiring unit of the information providing device 30a. 35 notifies the transmission terminal 10aa of the start of display data transmission (step S22).

  In the transmission terminal 10aa notified of the start of display data distribution, the external information determination unit 20 confirms the state of the reception flag (step S23), and if it is determined to be false, requests the relay device 40 to start display data distribution. Instruction information (hereinafter referred to as a distribution start request) is transmitted (step S24).

  As the relay device 40, the one relay device 40 selected by the function of the narrowing-down unit 18 described above is used. In addition, when transmitting to the relay device 40, an address such as an IP address or a domain name specified from the terminal ID of another transmission terminal 10 registered in the management table 231 is transmitted together with the address of the own transmission terminal 10. By doing so, a request is made to transfer to all transmission terminals 10 (including the own transmission terminal 10) in the conference with the own transmission terminal 10 (hereinafter the same).

  When receiving the distribution start request from the transmission terminal 10aa, the relay device 40 starts display data distribution to the transmission terminal 10aa that has transmitted the distribution start request and to other transmission terminals 10 that are in communication with the transmission terminal 10aa. A delivery start event to be notified is notified (steps S25 and S26). In addition, when the transmission terminal 10aa receives the distribution start event from the relay device 40, the external information determination unit 20 transmits information (hereinafter referred to as “transmittable information”) instructing the start of display data transmission to the information providing device 30a. (Step S27).

  When the information providing apparatus 30a receives the transmittable information from the transmission terminal 10aa, the display data communication unit 36 transmits the display data acquired by the display data acquisition unit 35 to each transmission terminal 10 via the transmission terminal 10aa (step). S28). This transmission process will be described in detail as follows.

  First, the display data acquisition unit 35 of the information providing apparatus 30a acquires the screen displayed on the display 306 as display data. Next, the display data communication unit 36 transmits the display data acquired by the display data acquisition unit 35 to the transmission terminal 10aa via the Bluetooth transmission / reception unit 32.

  When the transmission terminal 10aa connected to the information providing apparatus 30a via Bluetooth communication receives display data from the information providing apparatus 30a, the external information determination unit 20 uses the display data as the imaging unit 14 and the sound of the own transmission terminal 10aa. By outputting to the transmission / reception part 11 with the data (imaging data etc.) acquired by the input part 15, it transmits to the relay apparatus 40 via the communication network 2. FIG.

  The relay device 40 transmits (distributes) the data transmitted from the transmission terminal 10aa to each transmission terminal 10. At this time, the display data of the information providing device 30a transferred by the relay device 40 is also transmitted to the transmission terminal 10aa as the transmission source. Further, the display control unit 17 of the transmission terminal 10aa does not display the data before being transmitted to the relay device 40 but displays the data after passing through the relay device 40. Similarly, the image data captured by the camera 113 of each transmission terminal 10 is once transmitted to the relay device 40 and the image data returned from the relay device 40 is displayed.

  By performing the above processing, the delay time until each transmission terminal 10 receives the display data becomes almost the same regardless of which information providing device 30 transmits the display data. Therefore, for example, when the user of the information providing device 30a sends a page of the material (displays the next or previous page) on the information providing device 30a, the display content of each transmission terminal 10 is changed almost at the same time. Therefore, it is possible to smoothly communicate even in a remote conference. The same applies to the imaging data, and the delay time until the imaging data is displayed on each transmission terminal 10 can be made substantially equal on all the transmission terminals 10.

  Returning to the description of the processing in FIG. In the information providing apparatus 30a, when the display data communication unit 36 starts transmission of display data, the display data acquisition unit 35 uses a start button for instructing start of distribution displayed on the display 306 to instruct to stop distribution. To a stop button (step S29). Here, FIGS. 28-1 and 28-2 are diagrams showing display screens displayed on the display 306 of the information providing apparatus 30, and correspond to the screens of FIGS. 26-1 and 26-2 described above, respectively. doing. In FIGS. 28A and 28B, the stop button B32 is a button for instructing the stop of display data distribution, and the start shown in FIGS. The button B31 is switched from the display. As will be described later, the transmission of the display data is stopped when the stop button B32 is pressed.

  Returning to FIG. 27, in each transmission terminal 10 that has received the display data, the external information determination unit 20 sets the reception flag to true (steps S30 and S31), and the display control unit 17 changes the screen layout of the display data and the imaging data. Reconfiguration is performed (steps S32 and S33). Specifically, as described with reference to FIG. 13, the display data transmitted from the information providing device 30a is arranged and displayed in the display area A21, and the imaging data captured by each transmission terminal 10 is displayed in the display area A22 and thereafter. Sequentially arrange and display.

  As described above, by arranging (displaying) the start button for instructing the start of transmission of display data on the display 306 of the information providing apparatus 30, the display data can be displayed by an easy operation in which the user presses the start button. Can be transmitted (distributed) to each transmission terminal 10. In addition, by switching the start button / stop button according to the display data transmission state, it is easy to check whether the display data is distributed. Can be prevented.

  Next, with reference to FIG. 29, a processing example when switching from the state in which the display data of the information providing apparatus 30a is transmitted to the transmission of the display data of the information providing apparatus 30c will be described. Here, FIG. 29 is a diagram for explaining a processing procedure when switching the display data transmission source. 29 shows an example in which the start button B31 of the information providing apparatus 30c is pressed after the above-described process of FIG.

  When the operation input receiving unit 33 of the information providing device 30c receives a pressing input of the start button B31 from the user (step S41), the display data acquiring unit 35 of the information providing device 30c transmits a display data distribution start to the transmission terminal. 10ca is notified (step S42).

  In the transmission terminal 10ca notified of the start of display data distribution, the external information determination unit 20 confirms the state of the reception flag (step S43), and if it is determined to be true, requests the relay device 40 to stop display data distribution. Instruction information (hereinafter referred to as distribution stop request) is transmitted (step S44).

  When receiving the distribution stop request from the transmission terminal 10ca, the relay device 40 stops the distribution of display data to the transmission terminal 10ca that has transmitted the distribution stop request and to other transmission terminals 10 that are communicating with the transmission terminal 10ca. A delivery stop event to be notified is notified (steps S45 and S46).

  In the external information determination unit 20 of each transmission terminal 10 that has received the distribution stop event, the information providing device 30 connected to the transmission terminal 10 is instructed to stop transmission of display data (hereinafter referred to as transmission stop information). ) Is transmitted (steps S47 and S48). The display data acquisition unit 35 of the information providing device 30a that is transmitting the display data stops the transmission of the display data with the reception of the transmission stop information, so that the relay device 40 transmits the display data to each transmission terminal 10. Distribution is stopped (step S49).

  Further, when receiving the transmission stop information, the display data acquisition unit 35 of each information providing device 30 changes the display of the stop button B32 displayed on the display 306 to the start button B31 instructing the start of display data transmission. (Steps S50 and S51). By this processing, the stop button B32 of the information providing apparatus 30a shown in FIG. 28-1 or the like is changed to a start button B31 as shown in FIG. 26-1. The display change is performed in the same manner in the information providing apparatus 30c. However, since the start button B31 is already displayed, the appearance from the user of the information providing apparatus 30c is not changed.

  Next, when the external information determination unit 20 of each transmission terminal 10 sets the reception flag to false (steps S52 and S53), the display control unit 17 clears the display data displayed in the display area A21 of the display 306. The display screen is rearranged by sequentially arranging and displaying the imaging data of each transmission terminal 10 after the display area A21 (steps S54 and S55). Further, the external information determination unit 20 of the transmission terminal 10ca transmits a distribution start request to the relay device 40 (step S56). In subsequent steps S57 to S65, processing similar to that in steps S25 to S33 described in FIG.

  Thereby, the display data of the information providing device 30c is arranged in the display area A21 of the display screen of each transmission terminal 10, and the other image data is sequentially arranged after the display area A22. Even if the display data of the other site is displayed on the screen of the transmission terminal 10, the user of the own site can easily enter the information providing device 30 of the own site by pressing the start button of the information providing device 30. The displayed display data can be transmitted to the transmission terminal 10 at each site, and the screen can be switched to the display data on the local site side.

  Next, a processing example when stopping display data transmitted from the information providing apparatus 30 will be described with reference to FIG. Here, FIG. 30 is a diagram for explaining a procedure of processing when transmission of display data is stopped. 30 illustrates an example in which the stop button B32 of the information providing apparatus 30c is pressed after the above-described process of FIG.

  When the operation input receiving unit 33 of the information providing device 30c receives a press input of the stop button B32 from the user (step S71), the display data acquiring unit 35 of the information providing device 30c stops the distribution of the display data to the transmission terminal. 10ca is notified (step S72). Subsequent steps S73 to S85 are the same as steps S43 to S55 described in FIG.

  Thereby, transmission of display data from the information providing apparatus 30c is stopped, and only image data is displayed on the display screen of each transmission terminal 10. Of the display screen of each transmission terminal 10, the display area A21 is arranged with the image data of the base where the conversation is performed as described above. As described above, the user of the information providing apparatus 30 can stop the transmission of the display data by an easy operation of pressing the stop button B32.

  In addition, according to the processing shown in FIGS. 27, 29 and 30, when the display screen (display data) of the information providing device 30 is shared by each transmission terminal 10, the information providing device 30 is changed to the desired transmission terminal 10. Since display data can be distributed to other transmission terminals 10 via the transmission terminal 10 by being close to each other, there is no need to perform a network connection procedure for each conference base, and display data can be easily shared. Can be done. Further, since it is not necessary to prepare another network infrastructure technology for screen sharing, it is possible to prevent an increase in cost.

  In addition, by requesting each relay terminal 10 to start or stop distribution to the relay device 40, it is determined which relay terminal 10 (information providing device 30) is in a state of transmitting display data. There is no need to manage on the side. Thereby, although it is necessary to limit the display data transmitted from the information providing device 30 to one base, the processing load of the relay device 40 is reduced, and more transmission terminals 10 can be relayed. , Scalability can be improved.

  Note that the GUI for instructing start or stop of transmission displayed on each information providing device 30 is not limited to buttons (start button B31, stop button B32), and a menu is displayed so that the user can select. May be. Also, label the start button B31 and the stop button B32 (for example, “start screen sharing” for the start button B31, “end screen sharing” for the stop button B32), and the content of processing that occurs when the button is pressed. May be displayed. Further, text data such as “screen can be shared” and “screen is being shared” may be displayed together with the start button B31 and the stop button B32.

  As described above, in this embodiment, the user places the information providing apparatus 30 close to the multi-function device 80, instructs the multi-function device 80 to scan the document to be scanned, and scans the multi-function device 80. Scan the target document. Then, the information providing device 30 receives the scanned document data from the multi-function device 80, stores the received data in a predetermined storage location of the information providing device 30, and associates the file name of the data with the storage location. Are registered in the file management table in the information providing apparatus 30. Then, the user brings the information providing apparatus 30 close to the transmission terminal 10, selects data to be shared from the storage location in the information providing apparatus 30, and transmits the data to the transmission terminal 10. The transmission terminal 10 shares the data in an electronic conference. Therefore, according to the present embodiment, the data scanned by the multi-function device 80 can be easily shared.

(Embodiment 2)
FIG. 31 is a block diagram illustrating functional configurations of the transmission terminal 3110, the information providing apparatus 30, and the multi-function device 80 according to the second embodiment. In the present embodiment, the control procedure in which the information providing apparatus 30 transmits display data and the control procedure in which the information providing apparatus 30 stops transmitting display data are different from those in the first embodiment.

  As illustrated in FIG. 31, the transmission terminal 3110 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14, a sound input unit 15, a sound output unit 16, a display control unit 17, and a narrowing unit 18. A storage / reading processing unit 19, an external information determination unit 20, an arrangement information selection unit 3125, an NFC transmission / reception unit 21, and a Bluetooth transmission / reception unit 22. Each of these units is a function realized by any one of the constituent elements shown in FIG. 2 or a means to be realized by operating according to a command from the CPU 101 according to the transmission terminal program expanded in the RAM 103. is there. Here, the transmission / reception unit 11, the operation input reception unit 12, the login request unit 13, the imaging unit 14, the sound input unit 15, the sound output unit 16, the display control unit 17, the narrowing unit 18, the storage / read processing unit 19, the external The information determination unit 20, the NFC transmission / reception unit 21, and the Bluetooth transmission / reception unit 22 are the same as those in the first embodiment.

  Further, the transmission terminal 3110 has a storage unit 23 constructed by the SSD 105 shown in FIG.

  The storage unit 23 stores a management table 231, an authentication table 232, a display data acquisition program 233, a data transmission driver, and the like, an arrangement information management table 3123, and an event flag table 3124. Here, the management table 231, the authentication table 232, the display data acquisition program 233, the driver for data transmission, and the like are the same as those in the first embodiment.

  The arrangement information selection unit 3125 selects a shared flag from the event flag table 3124 and sets it in the arrangement information management table 3123 based on the display data distribution event, thereby causing the display control unit 17 to display the arrangement information of the screen to be displayed on the display 130. Instruct. Details of the control using the arrangement information management table 3123 and the event flag table 3124 will be described later.

[Display control of display data]
Hereinafter, display control of display data according to this embodiment will be described in detail.
(Location information management table)
FIG. 32 is a diagram illustrating an example of the arrangement information management table 3123. In the arrangement information management table 3123, information for managing the arrangement of display data is registered. “Arrangement information No” is identification information for identifying a record, and “Arrangement information” stores information on how to arrange video data and display data on the display 100. The arrangement information includes “VIEW_MULTI” and “SHARED_MULTI”. As will be described later, “VIEW_MULTI” means that only video data is displayed, and “SHARED_MULTI” means that video data and display data are mixedly displayed.

  The “shared flag” is determined by the arrangement information selection unit 3125 with reference to the event flag table 3124 in FIG. 36 based on the distribution event. The “location information No” is uniquely determined by the “shared flag”. There are the following two states in which the transmission terminal 3110 receives display data.

The transmission terminal 3110 connected to the information providing apparatus 30 is receiving display data from the information providing apparatus 30. The transmission terminal 3110 displays from the information providing apparatus 30 connected to another transmission terminal 3110. Data is being received

  In the present embodiment, both of these two states are referred to as “SHARED”. A state in which the transmission terminal 3110 has not received any display data is referred to as “UNSHARED”. If the shared flag of the transmission terminal 3110 is “SHARED”, the arrangement information management table 3123 is associated with the arrangement information of “SHARED_MULTI” of the arrangement information No 2, and “VIEW_MULTI” of the arrangement information No 1 if the shared flag is “UNSHARED”. It is linked with the arrangement information of.

  Note that the association between the shared flag and the arrangement information is an example, and in an extreme case, the association can be reversed. In addition, the two states in which the transmission terminal 3110 receives the display data are not set to the same “SHARED”, but the two receiving states are set to “SHARED1” and “SHARED2”, and can be associated with different arrangement information. Setting of the arrangement information management table 3123 can be performed by each participant of the transmission terminal.

  FIG. 33 is an example of a diagram illustrating an example of division of the display 130 and an area generated by the division. Since different video data or display data can be displayed in each of the areas 1 to 4, a maximum of four video data and display data can be displayed in this example. In FIG. 33, the area 1 is allocated wider than the other areas 2 to 4. The “placement information” determines which area of the areas 1 to 4 the video data is displayed and in which area the display data is displayed.

  FIG. 34 is a diagram illustrating an example of a relationship between arrangement information and video data or display data assigned to each of the areas 1 to 4. As shown in FIG. 34, when arrangement information = “VIEW_MULTI”, video data 1 is displayed in area 1, video data 2 is displayed in area 2, and video data is displayed in all areas 1 to 4. . When arrangement information = “SHARED_MULTI”, display data is displayed in area 1, video data 1 is displayed in area 2, and video data 2 is displayed in area 3.

The arrangement information will be described in detail.
In the case of “VIEW_MULTI”: Arrangement information in which video data is allocated in the number of video data received in each terminal in order from area 1. For example, when two transmission terminals 3110 are connected to the transmission management system 50, video data is displayed up to area 2, and nothing is displayed in areas 3 and 4. In the area 1, the transmission terminal 3110 displays the video data of the other party to which the participant is currently interested in, and the video data is taken by the imaging unit 14 of the transmission terminal 3110 on the speaking side. In order to specify this video data, when the sound input unit 15 of each transmission terminal detects an utterance based on the audio level, the display control unit 17 transfers the terminal ID of the corresponding transmission terminal 3110 to the relay device 40. Since the relay device 40 broadcasts this terminal ID to each transmission terminal 3110, each transmission terminal 3110 can specify video data to be displayed in the area 1. The display control unit 17 may transmit the terminal ID of the corresponding transmission terminal 3110 to the remote communication management system 50 instead of the relay device 40. In the area 2, video data on the side not speaking is displayed.
In the case of “SHARED_MULTI” This is arrangement information in which display data is displayed in area 1 and video data is allocated to other areas 2 to 4. When two transmission terminals 1 and 2 are connected to the transmission management system 50, the video data of each transmission terminal 3110 is displayed in area 2 and area 3, and nothing is displayed in area 4.

  The arrangement information selection unit 3125 determines whether display data is received from the information providing apparatus 30 connected to the transmission terminal 3110 of the own device and whether display data is received from other transmission terminals. Depending on the distribution event to be determined, the sharing flag of the own device is set to “SHARED” or “UNSHARED”. Setting “SHARED” means that “SHARED” “1” or “ON” is assigned to the value of the shared flag, and setting “UNSHARED” means that “UNSHARED” “0” or “ Substituting “OFF”.

  As described above, when the arrangement information selection unit 3125 updates the sharing flag, the display control unit 17 is instructed to display the video data and the display data in the areas 1 to 4 based on the result of referring to the sharing flag in the arrangement information management table 3123. Change the assignment.

  FIG. 35 is an example of a state transition diagram of arrangement information selected by the arrangement information selection unit 3125. Whether the initial state is No. 1 or No. 2 in the arrangement information varies depending on whether display data is being transmitted to the transmission terminal 3110 immediately after startup, which is its own device. As illustrated in FIG. 35, when the arrangement information selection unit 3125 sets “SHARED” in the shared flag in a state where the arrangement information No. 1 is selected, the arrangement information selection unit 3125 selects the arrangement information No. 2. When the arrangement information selection unit 3125 sets “UNSHARED” in the shared flag in a state where the arrangement information No. 2 is selected, the arrangement information selection unit 3125 selects the arrangement information No. 1. When the arrangement information No. 1 is selected and the arrangement information selection unit 3125 sets “UNSHARED” in the shared flag, the arrangement information selection unit 3125 selects the arrangement information No. 1 as it is and the arrangement information No. 2 is selected. When the arrangement information selection unit 3125 sets “SHARED” as the shared flag, the arrangement information selection unit 3125 selects the arrangement information No 2 as it is.

(Display control flag)
The display control flag is used by the transmission terminal 3110 to control display of a menu or the like displayed on the display 306 of the information providing apparatus 30 by the information providing apparatus 30. FIG. 36 illustrates an example of correspondence between a distribution event transmitted from the relay device 40, a display flag set by the arrangement information selection unit 3125 according to the distribution event, and a display control flag determined by the display control unit 17 (event flag). Table 3124).

  Distribution events include “distribution start event”, “distribution start event from other”, “distribution stop event”, and “distribution stop event from other”. The sharing flag of the former two distribution events is “SHARED” corresponding to the distribution event in which the transmission terminal 3110 receives the display data, and the transmission flag 3110 does not receive the display data in the sharing flag of the latter two distribution events. “UNSHAED” corresponding to the distribution event.

  Further, the display control flag corresponding to the “delivery start event” is “SHARED”, the display control flag corresponding to the “delivery start event from other” is “SHARED_ANOTHER”, the “delivery start event” and “from other” The display control flag corresponding to “Delivery stop event” is “UNSHARED”. The display control flag will be described below. When the display control unit 34 of the information providing apparatus 30 receives the display control flag from the transmission terminal 3110, the display control unit 34 changes the menu displayed on the display 306.

  FIG. 37A is an example of a diagram that schematically illustrates an example of the transition condition table stored in the storage unit 38 of the information providing apparatus 30. The display 306 immediately after startup displays “Start sharing” on the assumption that the transmission terminal 3110 does not share display data. “Start sharing” is a menu for starting to share the display data of the information providing apparatus 30 with a transmission terminal 3110 other than the transmission terminal connected to the information providing apparatus 30, and specifically accepts a participant's operation. This is a “share start” button (hereinafter, “share start” and “share start” buttons are used strictly without being properly used).

  When the information providing apparatus 30 receives the display control flag “SHARED” while “sharing start” is displayed, the display control unit 34 displays “sharing stop” for canceling sharing of the display data. “Stop sharing” is a menu for stopping the display data displayed by the information providing apparatus 30 from being shared with the transmission terminal 3110 not directly connected to the information providing apparatus 30. This button is a “stop sharing” button that accepts the user's operation (hereinafter, “stop sharing” and “stop sharing” buttons are used strictly without being used properly).

  When the information providing apparatus 30 receives a display control flag other than the display control flag “SHARED” (“UNSHARED”, “SHARED_ANOTHER”) while “sharing stop” is being displayed, the display control unit 34 is configured to “share” so that display data sharing can be started. “Start” is displayed.

  If the information providing apparatus 30 receives a display control flag other than “SHARED” while the “sharing start” is displayed, the menu remains unchanged, and the display control flag is displayed while the information providing apparatus 30 displays “sharing stop”. If “SHARED” is received, the menu remains unchanged.

  Thus, the display of the information providing apparatus 30 is performed according to the display mode of the display data and video data displayed on the display 130 by the transmission terminal 3110 by associating the sharing flag and the display control flag with the distribution event. The display mode (menu) of 306 can also be determined.

  Then, while the menu is displayed on the display 306 of the information providing device 30, the display control unit 34 displays the sharing state according to the display control flag.

FIG. 37B is a diagram illustrating an example of a correspondence relationship between the display control flag and the shared state. Such a correspondence relationship is stored in the storage unit 38 together with the transition condition table. As will be described later, this “sharing state” is displayed in the message column of the screen of the information providing apparatus 30 so that the participant can grasp the “current sharing state” of the transmission terminal 3110. The “shared state” includes the following states.
(A) Transmission terminal 3110 does not share display data (UNSHARED)
(B) The transmission terminal 3110 shares the display data displayed by the information providing apparatus 30 connected to the own terminal (SHARED)
(C) The transmission terminal 3110 shares the display data displayed by the information providing apparatus 30 connected to the other transmission terminal 3110 (SHARED_ANOTHER)

<Display data sharing start processing>
FIG. 38 is an example of a sequence diagram illustrating a control procedure when two information providing apparatuses 30 (information providing apparatuses 1 and 2) start transmitting display data.

  By the way, as described above, the display flag until the transmission terminal 3110 receives display data is “UNSHARED”. Therefore, only video data is displayed on the screen of the display 130 of the transmission terminal 3110.

  The state of the screen of the display 130 until the transmission terminal 3110 receives display data will be described with reference to FIGS. That the display flag of the arrangement information management table 3123 is “UNSHARED” is a state in which the arrangement information selection unit 3125 has selected the arrangement information No1. Therefore, in this case, the video data received from the relay device 40 is displayed in the areas 1 and 2 as shown in FIG. Whether the placement information selection unit 3125 displays the video data of the own device or the video data of the other device in the area 1 is as described in the explanation of the placement information management table 3123. You may implement | achieve so that it may switch.

  Further, until the transmission terminal 3110 is notified of the distribution event, the display control unit 17 does not transmit any display control flag to the information providing apparatus 30 or transmits a display control flag of “UNSHARED” to the information providing apparatus 30. doing. The display control unit 34 of the information providing apparatus 30 displays a menu corresponding to the display control flag “UNSHARED” on the display 306 as a state immediately after activation.

  FIG. 39 is a diagram showing some examples of screens displayed on the information providing apparatus 30. When the session is not established, no characters are displayed on the menu 401 as shown in FIG. 39 (a), and a message “No meeting is occurring” is displayed on the menu 402. Yes.

  FIG. 39B shows an example of the menu 401 and the sharing state 402 displayed on the information providing apparatus 30. In FIG. 39B, a “sharing start” button is displayed as the menu 401, and a message “not sharing” is displayed as the sharing state 402. The “share start” button can be pressed directly by the participant pressing the touch panel or by operating the keyboard 211 or the mouse 212.

  In FIG. 39B, the display data of the material possessed by the information providing device 30 is displayed, and in addition, the status display window and the display data of another material are displayed. When the participant shares the display data being displayed by the information providing apparatus 30 with another transmission terminal 2, the participant presses a “start sharing” button. Thereby, the information provision apparatus 30 starts transmission of display data.

  Returning to FIG. 38, the operation input receiving unit 33 receives a press of an item “start sharing” button displayed on the information providing apparatus 1 by the participant (step S3801). Then, the display data communication unit 36 notifies the transmission terminal 1 of the start of sharing and starts transmission of display data (step S3802).

  Next, the display control unit 17 of the transmission terminal 1 requests the relay device 40 to start distribution, and transmits display data to the relay device 40 (step S3803).

  The relay device 40 changes the quality of the display data, notifies the transmission terminal 1 of the “distribution start event”, and starts the distribution of the display data (step S3804).

  When acquiring the “distribution start event”, the arrangement information selection unit 3125 of the transmission terminal 1 sets the sharing flag to “SHARED” according to the event flag table 3124 (step S3805). The arrangement information selection unit 3125 of the transmission terminal 1 selects the arrangement information No2 according to the arrangement information management table 3123, and instructs the display control unit 17 to allocate video data and display data for each of the areas 1 to 4 (step S3806). ). As a result, the state of the display 130 changes from the state of FIG. 12 to the state of FIG. In FIG. 13, display data is displayed in area 1, and video data is displayed in areas 2 and 3.

  Since the “delivery start event” is notified to the transmission terminal 1, the display control unit 17 sets the display control flag to “SHARED” according to the event flag table 3124 and notifies the information providing apparatus 1 (step S3807).

  The display control unit 34 of the information providing apparatus 1 determines whether or not to change the display of the menu 401 according to the display control flag according to the transition condition table of FIG. 37A (step S3808).

  Since the information providing apparatus 2 receives the display control flag “SHARED” while the “sharing start” button is displayed as shown in FIG. 39B, the display control unit 34 sets the menu 401 on the display 306 to “ The button is changed to the “stop sharing” button (step S3809). FIG. 39C shows a screen example of the display 306 on which the “share stop” button is displayed.

  Further, since the display control unit 34 receives the display control flag “SHARED”, the display control unit 34 displays “This display is shared” in the sharing state 402 as shown in FIG. 39C (step S3810).

  The relay device 40 changes the quality of the display data, notifies the transmission terminal 2 of the “distribution start event from another”, and starts the distribution of the display data (step S3811).

  When the “distribution start event from another” is notified, the display control unit 17 of the transmission terminal 2 determines whether or not the relay apparatus 40 is requested to stop the distribution (step S3812). This determination is necessary to determine which display data is to be displayed when the transmission terminal 2 already shares the display data. Although this determination method will be described later, here, since the sharing flag is “UNSHARED”, no distribution stop request is made.

  When receiving the “distribution start event from another”, the arrangement information selection unit 3125 of the transmission terminal 2 sets the shared flag of the arrangement information management table 3123 to “SHARED” according to the event flag table 3124 (step S3813).

  The arrangement information selection unit 3125 of the transmission terminal 2 selects the arrangement information No2 because the shared flag is set to “SHARED” from the arrangement information management table 3123, and the display control unit 17 displays the video data and the display for each of the areas 1 to 4. Data allocation is instructed (step S3814). As a result, the state of the display 130 changes from the state of FIG. 12 to the state of FIG.

  Since the transmission terminal 2 is notified of the “distribution start event from another” in step S3811, the display control unit 17 sets the display control flag to “SHARED_ANOTHER” according to the event flag table 3124 and notifies the information providing apparatus 2 ( Step S3815).

  The display control unit 34 of the information providing apparatus 1 determines whether to change the display of the menu 401 according to the display control flag according to the transition condition table of FIG. 37 (step S3816). Since the information providing apparatus 2 receives the display control flag “SHARED_ANOTHER” while the “sharing start” button is displayed as illustrated in FIG. 39B, the display control unit 34 changes the menu 401 of the display 306. do not do.

  The display control unit 34 refers to the display control flag and displays the sharing state 402 “other display is shared” on the display 306 (step S3817).

  FIG. 39D shows an example of a screen displayed on the display 306 of the information providing apparatus 2 when the transmission terminal 2 shares the display data of the transmission terminal 1. In FIG. 39 (d), the menu 401 is “Start sharing”, but the sharing state 402 displays “Share other displays”.

  As described above, in the information providing apparatus 1, the menu 401 is changed from the “start sharing” button to the “stop sharing” button, and the sharing state 402 changes from “not shared” to “share this display”. Is changed. In the information providing apparatus 2, the menu 401 is not changed, and the sharing state 402 is changed from “not shared” to “shared other display”. Accordingly, the participant can share the display data by operating the menu 401, and by viewing the sharing state 402, the transmission terminal 3110 to be operated is displayed with the information providing apparatus 30 connected to the own device. You can see at a glance whether you are sharing data.

<Switching display data to be shared>
A processing procedure for transmitting display data from the information providing apparatus 2 after the processing of FIG. 38 will be described. 13 is displayed on the display 130 of the transmission terminals 1 and 2, FIG. 39C is displayed on the display 306 of the information providing apparatus 1, and FIG. 39D is displayed on the display 306 of the information providing apparatus 2. .

  FIG. 40 is an example of a sequence diagram illustrating a control procedure when the information providing apparatus 2 starts to transmit display data. The processing of steps S4001, S4002, S4003, and S4011 is omitted because the information providing apparatus 1 is changed to the information providing apparatus 2 in FIG.

  When the “distribution start event from another” is notified, the display control unit 17 of the transmission terminal 1 determines whether or not the relay device 40 is requested to stop the distribution (step S4012).

  As will be described later, since the sharing flag of the transmission terminal 1 is “SHARED”, the display control unit 17 requests the relay device 40 to stop distribution (step S4013). The relay device 40 performs processing to be described later, and stops transmission of display data. Here, since the relay device 40 is requested to start distribution from the transmission terminal 2, there is other display data distributed by the relay device 40, and therefore no distribution stop event occurs.

  The display control unit 17 of the transmission terminal 1 requests the information providing apparatus 1 to stop transmission of display data in order to respond to the “delivery start event from another” (step S4014). Thereby, the display data to be shared can be limited to one. The display control flag “SHARED_ANOTHER” may be used to request stop of display data transmission.

  The display data communication unit 36 of the information providing apparatus 1 stops transmission of display data (step S4015). The transmission of display data is stopped by this stop.

  Since the arrangement information selection unit 3125 of the transmission terminal 1 has received the “delivery start event from another”, the sharing information is set to “SHARED” according to the event flag table 3124 (step S4016).

  The arrangement information selection unit 3125 of the transmission terminal 1 selects the arrangement information No. 2 in the arrangement information management table 3123 and instructs the display control unit 17 to associate the areas 1 to 4 with display data and video data (step S4017).

  Since the transmission terminal 1 is notified of the “delivery start event from another” in step S4011, the display control unit 17 notifies the information providing apparatus 1 of the display control flag “SHARED_ANOTHER” according to the event flag table 3124 ( Step S4018).

  The display control unit 34 of the information providing apparatus 1 determines whether or not to change the display of the menu 401 based on the transition information table of FIG. 37A (step S4019).

  Since the display control unit 34 has received the notification of the display control flag “SHARED_ANOTHER” in the state where “sharing stop” is displayed, the display control unit 34 displays the “sharing start” button on the display 306 (step S4020).

  Further, the display control unit 34 refers to the display control flag “SHARED_ANOTHER” and displays a message “other display is shared” in the sharing state 402 on the display 306 (step S4021). The display 306 of the information providing apparatus 1 becomes as shown in FIG. 39D by steps S4020 and S4021.

  On the other hand, when the distribution information selection unit 3125 of the transmission terminal 2 acquires the distribution start event, it sets the sharing flag to “SHARED” according to the event flag table 3124 (step S4005).

  The arrangement information selection unit 3125 of the transmission terminal 2 selects the arrangement information No2 according to the arrangement information management table 3123, and assigns video data and display data to the display control unit 17 for each of the areas 1 to 4 (step S4006). Since the arrangement information selection unit 3125 has already selected the arrangement information No2 in S3814 of FIG. 38, the arrangement information No2 is selected again.

  Since the transmission start event is notified to the transmission terminal 2 in step S4004, the display control unit 17 sets the display control flag to “SHARED” according to the event flag table 3124 and notifies the information providing apparatus 2 (step S4007). .

  The display control unit 34 of the information providing apparatus 2 determines whether or not to change the display of the menu 401 according to the display control flag according to the transition information table 431 of FIG. 37A (step S4008).

  Since the information providing apparatus 2 receives the display control flag “SHARED” while the “sharing start” button is displayed as shown in FIG. 39D, the display control unit 34 displays the menu 401 on the display 306 as “ The button is changed to the “share stop” button (step S4009).

  Further, since the display control unit 34 has received the display control flag “SHARED”, the display control unit 34 displays “This display is shared” in the sharing state 402 as shown in FIG. 39C (step S4010). Therefore, the screen of the display 306 is as shown in FIG.

  As described above, when the process of FIG. 40 is completed, the display 306 of the information providing apparatus 1 becomes as shown in FIG. 28D, and the display 306 of the information providing apparatus 2 becomes as shown in FIG. That is, in the information providing apparatus 1, the menu 401 is changed from “sharing stop” to “sharing start”, and the sharing state 402 is changed from “sharing this display” to “sharing other displays”. Is done. In the information providing apparatus 2, the menu 401 is changed from “sharing start” to “sharing stop”, and the sharing state 402 is changed from “sharing other displays” to “sharing this display”. Is done.

  As described in S <b> 4014, the information providing apparatus 1 stops the display data transmission in response to the “distribution start event from other” from the relay apparatus 40, so the display data displayed by each transmission terminal 3110 is made one. Can be limited.

<Determination of distribution stop request in S3812 in FIG. 38>
FIG. 41 is an example of a flowchart illustrating a procedure for determining whether or not to request a distribution stop when the transmission terminal 3110 receives a “distribution start event from another”.

  This process is activated when the transmission terminal 3110 receives a distribution start event from another (S4101).

  Upon receiving the “distribution start event from another”, the display control unit 17 determines whether or not the sharing flag is set to “SHARED” (step S4102). When the sharing flag is “SHARED”, the display data distributed by the information providing apparatus 1 connected to the own apparatus or the other information providing apparatus 2 is shared. Can't handle “distribution start event from others”.

  Therefore, when the sharing flag is “SHARED” (Yes in step S4102), the display control unit 17 requests the relay device 40 to stop distribution (step S4103). The relay device 40 stops the display data distribution to the transmission terminal 3110 that requested the distribution stop.

<Determination in S4012 of FIG. 40>
In response to the distribution stop request from the transmission terminal 3110, the relay device 40 updates the display flag and the display control flag of the transmission terminal 3110, so that the “distribution stop event” or “delivery stop from other” is sent to all other transmission terminals. It is determined whether to notify “event”.

  FIG. 42 is an example of a flowchart illustrating a determination procedure of the relay device 40. First, the relay device 40 stops the distribution of the display data requested to stop distribution (step S4201).

  Next, the relay device 40 determines whether there is still display data being distributed (step S4202). That is, display data is transmitted from the base participating in the video conference to the relay device 40, and the relay device 40 determines whether or not it is distributed.

  If there is still display data being distributed (Yes in step S4202), the relay device 40 does not notify the transmission terminal of any “distribution stop event” in order to distribute the display data.

  If there is no more display data to be distributed (No in step S4202), the relay device 40 notifies the transmission terminal that requested the distribution stop to the “distribution stop event” in order to update the display flag and the display control flag of all the transmission terminals. ”And the other transmission terminal is notified of the“ delivery stop event from other ”(step S4203).

  In this way, when there is still display data being distributed, the transmission terminals 1 and 2 can accept display data distribution with the shared flag “SHARED”, and there is no display data being distributed. In this case, the sharing control flag “UNSHARED” can be notified to the information providing apparatuses 1 and 2.

[Stop sending display data]
Next, a procedure in which the information providing apparatus 2 stops transmission of display data in the state where the process of FIG. 40 has been completed will be described using the sequence diagram of FIG. When the participant wants to stop transmission of display data from the information providing apparatus 2 of his / her own device, the participant presses a “stop sharing” button of the menu 401 displayed on the information providing apparatus 2.

  The operation input accepting unit 33 of the information providing apparatus 2 accepts pressing of the “sharing stop” button (step S4301). Then, the display data communication unit 36 notifies the transmission terminal 2 that transmission is stopped (step S4302).

  The display control unit 17 of the transmission terminal 2 requests the relay device 40 to stop distribution (step S4303). The relay device 40 determines whether or not to notify a “distribution stop event” according to FIG.

  Since the display data already distributed by the relay device 40 is only the display data transmitted from the transmission terminal 2, the relay device 40 notifies the transmission terminal 2 of a “distribution stop event” (step S4304) and “distribution from other”. The “stop event” is distributed to the transmission terminal 1 (step S4313, S4203 in FIG. 42). Thereby, the distribution of the display data is stopped. When the relay device 40 transmits the “distribution stop event”, the relay device 40 does not need to transmit the stop of display data distribution in S4201 of FIG. A delivery stop may be sent.

  Upon receiving the “distribution stop event”, the display control unit 17 of the transmission terminal 2 requests the information providing apparatus 2 to stop the display data transmission (step S4305).

  The display data communication unit 36 of the information providing device 2 stops the transmission of display data (step S4306). Due to this stop, the transmission of the display data is stopped. Note that display data transmission may be stopped in step S4302.

  The arrangement information selection unit 3125 of the transmission terminal 2 sets the shared flag to “UNSHARED” according to the event flag table 3124 of FIG. 36 (step S4307).

  The arrangement information selection unit 3125 of the transmission terminal 2 selects the arrangement information No1 in the arrangement information management table 3123 according to the setting of the shared flag (step S4308). As a result, the display control unit 17 assigns video data to the areas 1 and 2 and displays the screen as shown in FIG.

  Further, since the “delivery stop event” is notified to the transmission terminal 2 in S4304, the display control unit 17 notifies the information providing apparatus 2 of the display control flag “UNSHARED” based on the event flag table 3124 (step S4309). ).

  The display control unit 34 of the information providing apparatus 2 determines whether or not to change the menu 401 according to the transition condition table of FIG. 37A (step S4310).

  Since the display control flag “UNSHARED” is received while the information providing apparatus 2 is displaying “sharing stop”, the display control unit 34 displays the “sharing start” button as the menu 401 on the display 306 (step S4311). .

  In addition, the display control unit 34 refers to the display control flag and displays the message of the sharing state 402 on the display 306 (step S4312). When the display control flag is “UNSHARED”, the message is “not shared”.

  The processing of steps S4314 to S4316 is almost the same as the processing of steps S4307 to S4309.

  That is, when receiving the “delivery stop event from another”, the display control unit 17 of the transmission terminal 2 sets the sharing flag to “UNSHARED” according to the event flag table 3124 of FIG. 36 (step S4314). Since transmission of display data has already been stopped, there is no need to request the information providing apparatus 1 to stop transmission of display data.

  The arrangement information selection unit 3125 of the transmission terminal 1 selects the arrangement information No1 in the arrangement information management table 3123 according to the setting of the shared flag (step S4315). As a result, the display control unit 17 assigns video data to the areas 1 and 2 and displays the screen as shown in FIG.

  In S4313, the transmission terminal 1 is notified of the “delivery stop event from other”, and therefore the display control unit 17 notifies the information providing apparatus 1 of the display control flag “UNSHARED” based on the event flag table 3124. (Step S4316).

  The display control unit 34 of the information providing apparatus 1 determines whether or not to change the menu 401 according to the transition condition table of FIG. 37A (step S4317).

  Since the display control flag “UNSHARED” is received while the information providing apparatus 1 displays “sharing start”, the display control unit 34 continues to display the “sharing start” button.

  Further, the display control unit 34 refers to the display control flag and displays the message of the sharing state 402 on the display 306 (step S4318). When the display control flag is “UNSHARED”, the message is “not shared”.

  When the above processing is completed, the information providing apparatus 1 and the display 306 of the information providing apparatus 2 are both as shown in FIG. In the information providing apparatus 1, the menu 401 remains “shared start” and is not changed, but the message in the sharing state 402 is changed from “other display is shared” to “not shared”. In the information providing apparatus 2, the menu 401 is changed from “sharing stop” to “sharing start”, and the message of the sharing state 402 is changed from “sharing this display” to “not sharing”. The

  The present embodiment is different from the first embodiment in the control procedure in which the information providing apparatus 30 transmits display data and the control procedure in which the information providing apparatus 30 stops transmitting display data. The effect of.

  The embodiment according to the present invention has been described above, but the present invention is not limited to this, and various modifications, substitutions, additions, and the like are possible without departing from the spirit of the present invention.

  For example, in the above-described embodiment, an example of a remote conference between distant locations is shown. However, the present invention is not limited to this. It may be used for a remote conference between conference rooms that are close to each other, or between places where the voice is not heard even in the same room. That is, the remote conference means not a conference that is directly faced but a conference that is performed via a transmission system. In addition, it is assumed that the meeting includes a case of a one-on-one meeting.

  In the above embodiment, the case where a video conference is performed by the transmission system 1 has been described. However, the present invention is not limited to this. It may be used for presentation.

DESCRIPTION OF SYMBOLS 1 Transmission system 2 Communication network 10 Transmission terminal 11 Transmission / reception part 12 Operation input reception part 13 Login request part 14 Imaging part 15 Sound input part 16 Sound output part 17 Display control part 18 Narrowing part 19 Memory | storage / reading process part 20 External information determination Unit 21, 31, 85 NFC transmission / reception unit 22, 32, 86 Bluetooth transmission / reception unit 23 Storage unit 231 Management table 232 Authentication table 233 Display data acquisition program 30 Information providing device 33 Operation input reception unit 34 Display control unit 35 Display data acquisition unit 36 Display data communication unit 37 Storage / reading processing unit 38 Storage unit 40 Relay device 50 Transmission management system 60 Router 70 Program providing system 80 Multifunction device 81 Scanner unit 82 Printer unit 83 Facsimile transmission / reception unit 84 Data processing unit 87 Usability determination unit 88 Authentication unit 89 Authentication data storage unit 3123 Arrangement information management table 3124 Event flag table 3125 Arrangement information selection unit

JP 2009-135865 A

Claims (3)

An information providing apparatus capable of communicating with an external communication terminal that communicates with at least one communication terminal,
Display means for displaying image data;
A communication interface for transmitting the image data to the external communication terminal by wireless communication;
While the external communication terminal is performing video communication with the communication terminal, the image data is acquired when transmitting the image data displayed on the display means by wireless communication to the external communication terminal. Acquisition means;
Have
The external communication terminal performs video communication with the communication terminal prior to the communication interface that transmits the image data by wireless communication,
The communication interface is
When transmitting the image data to the external communication terminal by wireless communication, the external communication terminal causes the communication terminal to display the image data as part of video communication being performed with the communication terminal. Information providing device. The information providing apparatus according to claim 1, further comprising a storage unit that stores the image data received from an image forming apparatus capable of communicating with the information providing apparatus. An information providing method for an information providing apparatus capable of communicating with an external communication terminal that communicates with at least one communication terminal,
A display step for displaying the image data on the display means;
A communication step of transmitting the image data to the external communication terminal by wireless communication;
While the external communication terminal is performing video communication with the communication terminal, the image data is acquired when transmitting the image data displayed on the display means by wireless communication to the external communication terminal. An acquisition step;
Have
The external communication terminal performs video communication with the communication terminal prior to the communication step of transmitting the image data by wireless communication,
The communication step includes
When transmitting the image data to the external communication terminal by wireless communication, the external communication terminal causes the communication terminal to display the image data as part of video communication being performed with the communication terminal. Information provision method.

Images