JP2018132933A - Communication terminal, communication system, image sharing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication terminal, a communication system, an image sharing method, and a program capable of preventing a communication terminal from transmitting an image on a display area not sharable to another communication terminal.SOLUTION: An input receiving unit 12 of a terminal 10 receives an input of a condition to share an image with another communication terminal. A share managing unit 15 of the terminal 10 creates a list of meeting materials indicating a window for displaying a sharable image among equal to or greater than one activated window on the basis of the condition received by the input receiving unit 12. A transmitting and receiving unit 11 of the terminal 10 transmits the image of the selected window from the list to another terminal.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a communication terminal, a communication system, an image sharing method, and a program.

  In recent years, communication systems that perform communication between bases via a communication network such as the Internet have become widespread. In such a communication system, for example, one communication terminal is installed at one site, and the other communication terminal is installed at the other site. When a conference or the like is performed using a communication system, one communication terminal captures an image of one user, collects comments and the like, and transmits them as content data to the other communication terminal. Thereby, the other communication terminal outputs the received content data. Further, the communication terminal can capture an image for each display area such as a window opened in the communication terminal. Thus, the communication terminal can also share the conference material between the bases by transmitting the image of the opened window as the conference material to the other communication terminal.

  In Patent Document 1, when the PC receives the material information and the device information, the PC creates and displays a list of materials that can be shared within the conference group to be integrated using the material information and the device information. It is disclosed that a material selected from a list is shared within a newly integrated conference group.

  However, in a communication terminal, even if a minimized display area is captured among display areas opened by an application such as a viewer, an image including content such as a file may not be obtained. For this reason, even if a communication terminal transmits an image in the display area to another communication terminal, the image may not be shared with the other communication terminal.

  The communication terminal of the invention according to claim 1 transmits an image of a selected display area among the one or more display areas for displaying an image by an active application in the communication terminal to another communication terminal. And a communication terminal that shares the image with the other communication terminal, the receiving unit receiving an input of a condition for sharing the image with the other communication terminal, and a condition received by the receiving unit. And generating means for generating a list indicating a display area for displaying the sharable image among one or more display areas for displaying an image by the running application, and selecting from the list Transmitting means for transmitting the displayed image of the display area to the other communication terminal.

  As described above, according to the present invention, there is an effect that it is possible to prevent a communication terminal from transmitting an image of a display area that cannot be shared to another communication terminal.

FIG. 1 is a schematic diagram of a communication system according to an embodiment. FIG. 2 is a conceptual diagram showing an example of a state of transmission / reception of various information in the communication system. FIG. 3 is a hardware configuration diagram of a terminal according to an embodiment. FIG. 4 is a functional block diagram of a terminal and a management system that constitute a part of the communication system according to the embodiment. FIG. 5 is a conceptual diagram showing each management table managed in the management system. FIG. 6 is a conceptual diagram showing each management table managed in the terminal. FIG. 7 is a sequence diagram illustrating an example of processing in which the terminal logs in to the management system. FIG. 8 is a sequence diagram illustrating an example of processing for establishing communication between terminals. FIG. 9 is a flowchart illustrating an example of processing for setting a sharable image condition. FIG. 10 shows an example of a dialog box for setting conditions for images that can be shared. FIG. 11 is a sequence diagram illustrating an example of processing for sharing an image. FIG. 12 is a flowchart illustrating an example of processing for determining whether an image can be shared. FIG. 13 is a display example of a display including a list of conference materials that can be shared.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<< Overall configuration of communication system >>
FIG. 1 is a schematic diagram of a communication system according to an embodiment. The communication system 1 is constructed by a plurality of communication terminals 10 and a communication management system 50. Hereinafter, “communication terminal” is simply referred to as “terminal”, and “communication management system” is simply referred to as “management system”. Although FIG. 1 shows one management system 50 and two terminals 10, three or more terminals 10 may be provided in the communication system 1, and in addition to the terminals 10 and the management system 50, Other devices may be provided.

  The communication system 1 includes a data providing system that transmits content data in one direction from one terminal 10 to the other terminal 10 or a communication system that transmits content data in both directions between a plurality of terminals 10. Examples of the communication system include a video conference system, a video phone system, and a chat system. Hereinafter, the content data is image data and sound data, the communication system 1 is a video conference system having a screen sharing function as an example of a communication system, and the terminal 10 is a general-purpose PC (Personal Computer) having a communication function. ) Will be described. The image of the image data includes an image of a conference participant or the like captured by the terminal 10 and an image of a conference material or the like opened by a viewer or an editor. These images may be moving images or still images, and may be both moving images and still images. Note that “video conference” is used synonymously with “video conference”.

  The plurality of terminals 10 and the management system 50 are communicably connected via the communication network 2. Each of the plurality of terminals 10 is installed at an arbitrary base such as a conference room at the Tokyo office in Japan or a conference room at the New York office in the United States. The plurality of terminals 10 perform communication between bases by transmitting and receiving image data and sound data. The terminal 10 is used not only in a plurality of remote offices but also in an arbitrary base such as the same office, outdoors and indoors, or outdoors and outdoors. When each terminal 10 is used outdoors, wireless communication such as a mobile phone communication network is performed. The terminal 10 is not limited to use in a video conference, but is used for general conversations between users.

  The management system 50 performs login authentication of the terminal 10, management of communication by the terminal 10, and the like. The management system 50 may be installed at the same site as the terminal 10 or may be installed at a different site.

  In the present embodiment, the communication network 2 is constructed by, for example, a LAN (Local Area Network), a dedicated line, and the Internet. The communication network 2 may have a place where wireless communication such as Wi-Fi (Wireless Fidelity) or Bluetooth (registered trademark) is performed in addition to wired communication.

  Other devices that can be connected to the communication network 2 include, for example, a relay device that relays content data between the terminals 10, and a program that transmits a terminal program to the terminal 10 and transmits a communication management program to the management system 50 Examples include a maintenance system that performs maintenance such as maintenance, management, and maintenance of at least one of the system, the terminal 10, and the management system 50.

  FIG. 2 is a conceptual diagram showing an example of a state of transmission / reception of various information in the communication system. Note that FIG. 2 shows an example in which content data is transmitted between a plurality of terminals 10 via the relay device 30. The communication between the terminals 10 is not limited to this, and may be performed by an arbitrary method such as P2P (Peer to Peer). As shown in FIG. 2, in the communication system 1, a management information session sei is established between the terminal 10 and the management system 50 for transmitting and receiving various types of management information such as a call control message. Is done. Further, a session sed1 for transmitting image data and a session sed2 for transmitting sound data are established between the terminals 10 via the relay device 30. Hereinafter, any one or more sessions among the sessions sed1 and sed2 for transmitting content data between the communication terminals 10 are represented as a session sed. The image data includes image data of participants in a video conference captured by the terminal 10 and image data such as conference materials displayed in a window opened on the terminal 10. For this reason, the image data transmission session sed1 may include a session for transmitting and receiving captured image data and a session for transmitting and receiving image data such as conference materials. Further, the image data may have basic data essential for reproducing the image and extended data for improving the quality of the image to be reproduced by combining with the basic data. In this case, the image data transmission session sed1 includes a session for transmitting / receiving basic data and a session for transmitting / receiving extension data. Note that the management system 50 may have the function of the relay device 30, and the session sed between the terminals 10 may be established via the management system 50.

<< Hardware Configuration of Embodiment >>
The hardware configuration of the terminal 10 according to an embodiment will be described with reference to FIG. FIG. 3 is a hardware configuration diagram of the terminal according to the embodiment. Hereinafter, a case where the terminal 10 is a general-purpose PC having a communication function will be described. When the terminal 10 is a dedicated device, the terminal 10 has the same or corresponding hardware configuration as described below.

  The terminal 10 is a CPU 101 (Central Processing Unit) that controls the operation of the entire terminal 10, a ROM 102 (Read Only Memory) that stores programs used to drive the CPU 101 such as an IPL (Initial Program Loader), and is used as a work area for the CPU 101. RAM 103 (Random Access Memory), HD 104 (Hard Disk) for storing various data such as programs for the terminal 10 and content data, and HDD 105 (Hard for controlling reading or writing of various data to the HD 104 according to the control of the CPU 101 A disk I / F 107 (Interface) for controlling reading or writing (storage) of data to a recording medium 106 such as a disk drive), a flash memory, or an IC card (Integrated Circuit Card), and a keyboard 108a for inputting user operations. And mouse 108 b, a power switch 109 for switching the power of the terminal 10 on and off, and a network I / F 111 for communication using the communication network 2 are provided.

  The terminal 10 also includes a built-in camera 112 that captures an image of a subject under the control of the CPU 101 to obtain image data, an image sensor I / F 113 that controls driving of the camera 112, a built-in microphone 114 that inputs sound, a sound A built-in speaker 115 that outputs sound, a sound input / output I / F 116 that processes input / output of a sound signal between the microphone 114 and the speaker 115 according to the control of the CPU 101, and a display that outputs an image generated based on image data 120, a display I / F 117 that transmits an image to the display 120 according to the control of the CPU 101, an external device connection I / F 118 for connecting various external devices, and the above-described components are electrically connected as shown in FIG. A bus line 110 such as an address bus and a data bus for connection to each other

  The camera 112 includes a lens and a solid-state imaging device that converts light into electric charges and digitizes an image (video) of a subject. As the solid-state imaging device, a complementary metal oxide semiconductor (CMOS), a charge coupled device (CCD), or the like is used.

  External devices such as an external camera, an external microphone, and an external speaker can be electrically connected to the external device connection I / F 118 by a USB (Universal Serial Bus) cable or the like.

  Since the management system 50 and the relay device 30 have the same hardware configuration as the terminal 10, the description thereof is omitted. Note that the management system 50 and the relay device 30 may not have a part of the hardware configuration of the terminal 10 such as the camera 112, the microphone 114, and the speaker 115, for example.

<< Functional Configuration of Embodiment >>
Next, a functional configuration of the communication system according to the embodiment will be described. FIG. 4 is a functional block diagram of the terminal 10 and the management system 50 that constitute a part of the communication system according to the embodiment. In FIG. 4, the terminal 10 and the management system 50 are connected so that they can communicate via the communication network 2.

<Functional configuration of management system>
The management system 50 includes a transmission / reception unit 51, an authentication unit 52, a terminal management unit 53, a session management unit 54, and a storage / readout unit 59. Each of these units is a function realized by any one of the constituent elements shown in FIG. 3 operating according to a command from the CPU 101 according to the program for the management system 50 developed from the HD 104 onto the RAM 103. is there. The management system 50 also includes a storage unit 5000 constructed by the ROM 102, the RAM 103, and the HDD 105. In the storage unit 5000, each DB (Database) is constructed by the following tables.

(Authentication management table)
FIG. 5A is a conceptual diagram showing an authentication management table. In the storage unit 5000, an authentication management DB 5002 is constructed by an authentication management table. In the authentication management table, an authentication password is associated with each communication ID of all the terminals 10 managed by the management system 50 and managed. The communication ID is information for specifying a communication destination in the communication system 1. As the communication ID, for example, identification information of the terminal 10, identification information of the user of the terminal 10, an account name, or the like is used. Hereinafter, a case where the terminal 10aa as the terminal 10 and the communication ID corresponding to the terminal 10ba are account names “01aa, 01ba” input by the user will be described.

(Terminal management table)
FIG. 5B is a conceptual diagram showing a terminal management table. In the storage unit 5000, a terminal management DB 5003 is constructed by a terminal management table. In the terminal management table, the IP address of the terminal 10 is managed in association with the communication ID of each terminal 10.

  Next, each functional unit of the management system 50 will be described. The transmission / reception unit 51 of the management system 50 transmits / receives various information to / from a communication partner via the communication network 2 by a command from the CPU 101 and the network I / F 111.

  The authentication unit 52 of the management system 50 authenticates the login request source according to a command from the CPU 101.

  The terminal management unit 53 of the management system 50 manages the state of the terminal 10 according to a command from the CPU 101.

  The session management unit 54 of the management system 50 manages the session sed between the terminals 10 according to a command from the CPU 101.

  The storage / reading unit 19 of the management system 50 stores various data in the storage unit 5000 and reads various data stored in the storage unit 5000 in accordance with instructions from the CPU 101.

<Functional configuration of terminal>
The terminal 10 includes a transmission / reception unit 11, an input reception unit 12, a display control unit 14, a sharing management unit 15, an image acquisition unit 16, and a storage / reading unit 19. Each of these units is a function realized by any one of the constituent elements shown in FIG. 3 operating according to a command from the CPU 101 in accordance with a terminal program developed from the HD 104 onto the RAM 103. In addition, the terminal 10 includes a storage unit 1000 configured by the ROM 102, the RAM 103, and the HDD 105. In the storage unit 1000, each DB (Database) is constructed by the following tables.

(Shared condition management table)
FIG. 6A is a conceptual diagram showing a sharing condition management table. In the storage unit 1000, a shared condition management DB 1001 is constructed by a shared condition management table. In the present embodiment, the sharable image is image data that allows the same image content to be displayed on both the terminal 10aa and the counterpart terminal 10ba by transmitting the image data of this image to the terminal 10ba. It is. In addition, an image that can be shared can be selected as an image included in the list of conference materials, that is, an image to be shared, in a process described later.

  The sharing condition management table in FIG. 6A manages the communication ID, the setting information regarding the image acquired from the minimized window, and the file extension in association with each other. The communication ID in the sharing condition management table is used to set a condition of an image that can be shared for each communication ID. The sharable image condition indicates a condition in which an image can be shared with other communication terminals. In the sharing condition management table, the setting information “true” indicates that the image acquired from the minimized window is set to be sharable, and “false” indicates that the image acquired from the minimized window is set. Indicates that sharing is not set. That is, if “false” is included in the sharing condition management table, an image acquired from a non-minimized window is a sharable image condition. The extension in the sharing condition management table indicates that the shareable image is at least an image generated from a file with the extension.

  In the example of the sharing condition management table in FIG. 6A, an image that can be shared by an account using the communication ID “01aa” is generated from at least a file with the extension “.txt, .doc, .ppt”. It indicates that the image acquired from the window cannot be shared when the window is minimized. In this embodiment, when a file is opened or activated to generate a window, the file and the window are said to correspond.

(Material management table)
FIG. 6B is a conceptual diagram showing a material management table. In the storage unit 1000, a material management DB 1002 is constructed by a material management table. In the material management table of FIG. 6B, a record is generated for each window currently opened in the terminal 10. Each record includes a material ID indicating an image of a window as a conference material, a file name acquired from the window title, information indicating the state of the window, and information indicating whether the image acquired from the window can be shared Are associated and managed. The information indicating the state includes “minimization” indicating that the window is minimized. The information indicating whether sharing is possible includes “true” indicating that sharing is possible and “false” indicating that sharing is not possible.

(Display order management table)
FIG. 6C is a conceptual diagram showing a display order management table. In the storage unit 1000, a display order management DB 1003 is constructed by a display order management table. In the display order management table of FIG. 6C, the communication ID is managed in association with the communication ID in association with the display order conditions of the meeting materials when displaying a list of sharable conference materials. The communication ID in the display order management DB 1003 is used to set the display order for each communication ID. The display order condition will be described later.

(Shared history management table)
FIG. 6D is a conceptual diagram showing a shared history management table. In the storage unit 1000, a shared history management DB 1004 is constructed by a shared history management table. In the sharing history management table of FIG. 6D, the material ID indicating the image of the window that has been shared in the past as the conference material, the file name acquired from the window title, and the communication of the other party that has shared this image The ID and the number of sharing are managed in association with each other.

  Subsequently, each functional unit of the terminal 10 will be described. The transmission / reception unit 11 of the terminal 10 transmits / receives various kinds of information to / from the communication partner via the communication network 2 according to instructions from the CPU 101 and by the network I / F 111.

  The input receiving unit 12 of the terminal 10 receives various operation inputs by the user by using commands from the CPU 101, the keyboard 108a, and the mouse 108b.

  The display control unit 14 of the terminal 10 performs control to output an image to the display 120 by a command from the CPU 101 and the display I / F 117.

  The sharing management unit 15 of the terminal 10 manages sharing of images between the terminals 10 according to instructions from the CPU 101.

  The image acquisition unit 16 of the terminal 10 acquires image data of an image displayed in the window by capturing an image of the window according to a command from the CPU 101.

  The storage / reading unit 19 stores various data in the storage unit 1000 and reads various data stored in the storage unit 1000 according to instructions from the CPU 101.

<< Process of Embodiment >>
Subsequently, processing according to the embodiment will be described.

(Login process)
FIG. 7 is a sequence diagram illustrating an example of processing in which the terminal 10 logs in to the management system 50. Hereinafter, a process in which the terminal 10aa logs into the management system 50 as an example of the terminal 10 will be described. Other terminals 10 can log in to the management system 50 by the same process.

  The input receiving unit 12 of the terminal 10aa receives an account name and a password as communication IDs (Step S1). The transmission / reception unit 11 of the terminal 10aa transmits a login request including the communication ID received by the input reception unit 12 and the password to the management system 50 (step S2). Note that the communication ID and password of the terminal 10aa may be stored in the storage unit 1000 in advance. In this case, the transmission / reception unit 11 of the terminal 10aa transmits a login request including the communication ID read from the storage unit 1000 and the password to the management system 50.

  The transmission / reception unit 51 of the management system 50 receives the login request transmitted by the terminal 10aa. When receiving the login request, the management system 50 acquires the IP address of the terminal 10aa that is the login request source.

  The authentication unit 52 of the management system 50 searches the authentication management table (see FIG. 5A) using the communication ID and password included in the login request as search keys, and the same communication in this authentication management table. Authentication is performed by determining whether a set of ID and password is managed (step S3). Hereinafter, a case where the authentication unit 52 determines that the login request source has a valid usage right will be described. When it is determined that the login request source has a valid usage right, the terminal 10aa logs in to the management system 50, thereby establishing a session sei between the terminal 10aa and the management system 50.

  The terminal management unit 53 of the management system 50 records the communication ID of the login request source terminal 10aa and the IP address of the login request source terminal 10aa in the terminal management table (see FIG. 5B) (see FIG. 5B). Step S4). The transmission / reception unit 51 of the management system 50 transmits the authentication result information indicating the authentication result by the authentication unit 52 to the terminal 10aa as the login request source (step S5). Thereby, the transmission / reception unit 11 of the login request source terminal 10aa receives the authentication result information.

(Establish communication between terminals)
Next, a process for establishing communication between terminals 10 will be described. FIG. 8 is a sequence diagram illustrating an example of processing for establishing communication between terminals. In the following, a process in which the terminal 10aa logged into the management system 50 and the terminal 10ba establish communication for a video conference will be described. Note that other terminals 10 logged in to the management system 50 can establish communication by the same processing.

  In the present embodiment, the number of video conferences simultaneously held by the client-side terminal 10 is limited to four as an example. For this reason, the terminal 10 designates one of the four conference room IDs and transmits a participation request to the management system 50. Note that the conference room ID is not identification information of an actual conference room, but is used for a plurality of terminals 10 to participate in a common session sed.

  When the user performs an operation of specifying the conference room ID on the terminal 10aa, the input receiving unit 12 receives an input of the conference room ID (step S21-1). Hereinafter, the case where the input conference room ID is “C01” will be described. When the input of the conference room ID is accepted, the transmission / reception unit 11 of the terminal 10aa transmits a request for participation in the conference including the input conference room ID “C01” to the management system 50 (step S22-1).

  The transmission / reception unit 51 of the management system 50 receives the participation request transmitted by the terminal 10aa. In response to the participation request, the session management unit 54 of the management system 50 establishes a session sed for transmitting image data and sound data between the relay device 30 and the terminal 10aa (step S23-1).

  When the user performs an operation of designating the same conference room ID “C01” as that designated at the terminal 10aa at the terminal 10ba, the input receiving unit 12 receives an input of the conference room ID (step S21-2). When the input of the conference room ID is accepted, the transmission / reception unit 11 of the terminal 10ba transmits a participation request including the input conference room ID “C01” to the management system 50 (step S22-2).

  The transmission / reception unit 51 of the management system 50 receives the participation request transmitted by the terminal 10ba. In response to the participation request including the conference room ID “C01”, the session management unit 54 of the management system 50 causes the participation request source terminal 10ba to participate in the session sed in which the terminal 10aa participates (step S23-2). In this process, the session management unit 54 of the management system 50 establishes a session sed for transmitting image data and sound data between the relay device 30 and the terminal 10ba.

  The transmission / reception unit 51 of the management system 50 transmits a participation notification including the communication ID of the terminal 10ba newly participating in the session sed to the terminal 10aa participating in the same session sed (step S24-1). In addition, the transmission / reception unit 51 transmits a participation notification including the communication ID of the terminal 10aa participating in the session sed to the terminal 10ba newly participating in the session sed (step S24-2).

  When the terminal 10aa and the terminal 10ba participate in the session sed, the transmission / reception unit 11 of the terminal 10aa and the terminal 10ba transmits the image data picked up by the camera 112 of the own terminal and the sound data collected by the microphone 114 to the session. It transmits to the relay apparatus 30 by sed. The relay device 30 relays image data and sound data transmitted from one of the terminal 10aa and the terminal 10ba to the other of the terminal 10aa and the terminal 10ba.

(Setting sharing conditions)
Next, processing for setting image conditions that can be shared between terminals 10 will be described. FIG. 9 is a flowchart illustrating an example of processing for setting a sharable image condition. In the following, a process for setting a sharable image condition in the terminal 10aa will be described, but a sharable image condition can also be set in the terminal 10ba by a similar process.

  The OS (Operating System) of the terminal 10 implements a window system. The OS allocates a window as a display area on the screen of the display 120 to each application while an application for video conference, a viewer, an editor, or the like is running on the terminal 10. The position and size of the window are changed according to the operation input by the user. In a state in which the window size is minimized, 0S does not display the window on the screen of the display 120, but displays an icon for restoring the window size.

  The input receiving unit 12 of the terminal 10aa receives a request for a dialog box for setting a sharable image condition according to an operation input by the user. The display control unit 14 of the terminal 10aa displays a dialog box according to the request on the display 120 (step S31).

  FIG. 10 shows an example of a dialog box for setting conditions for images that can be shared. This dialog box includes a check box for setting whether to share an image acquired from a minimized window. The user can check the “Share” or “Do not share” checkbox. The dialog box also includes a field for entering a file extension. When a user wants to share an image generated from a file with a predetermined extension, the user inputs the extension in a dialog box.

  The dialog box also includes radio buttons for setting the display order of the conference material in the conference material list. The user can select a radio button of “in order of the number of times of sharing for each partner” or “ID order” as the display order.

  The conditions set in the dialog box are not limited to the above. As another condition, for example, the terminal 10aa may accept, for each communication partner, setting of a condition when communicating with the communication partner.

  When the user presses the “OK” button after inputting each item in the dialog box, the input receiving unit 12 of the terminal 10aa receives an input of a condition (step S32).

  The sharing management unit 15 of the terminal 10aa stores, in the sharing condition management table (see FIG. 6A), the communication ID input in step S1, the setting information corresponding to the check box checked in step S32, and in step S32. Record the input file's extension in association. For example, when the dialog box is input as shown in FIG. 10, the share management unit 15 adds the communication ID “01aa”, the setting information “false”, and the extensions “.txt, .doc,. Record "ppt".

  Further, the share management unit 15 of the terminal 10aa records the communication ID input in step S1 and the display order condition selected in step S32 in association with each other in the display order management table (see FIG. 6C). . For example, when the display order condition is selected as shown in FIG. 10 in the dialog box, the sharing management unit 15 stores the communication ID “01aa” and the display order condition “shared for each partner” in the display order management table. Record in the order of "the most frequent".

(Share meeting materials)
Next, a process of sharing the conference material between the terminal 10aa and the terminal 10ba after the session sed is established will be described. FIG. 11 is a sequence diagram illustrating an example of processing for sharing an image as a conference material. Hereinafter, although the case where a meeting material is shared based on the request | requirement of terminal 10aa is demonstrated, a meeting material can also be shared based on the request | requirement of terminal 10ba by the same process.

  When the user performs an operation for requesting a list of sharable meeting materials on the terminal 10aa, the input receiving unit 12 receives a list request (step S41).

  When the request for list is received by the input receiving unit 12, the sharing management unit 15 of the terminal 10aa manages the currently activated window (step S42). The activated window refers to each display area assigned by the OS in order to display an image for each currently activated application in the terminal 10aa. In this process, the share management unit 15 acquires information such as the title of the active window, the window position, and the size from the OS. Note that for a window generated by opening a file by a viewer or the like, the file name of the file is acquired as a title in the above processing. When the acquired information and the information managed in the material management table (see FIG. 6B) are different, the sharing management unit 15 of the terminal 10aa determines the material management table based on the acquired information. Update.

  For example, if the share management unit 15 of the terminal 10aa acquires the file name of the newly opened window, the record including the acquired file name and the material ID is stored in the material management table (see FIG. 6B). ) To add. The material ID is generated by the share management unit 15 when a new file name is acquired.

  In addition, when the share management unit 15 of the terminal 10aa acquires the file name of the window and information indicating a state in which the window is minimized, the share management unit 15 acquires the information in the material management table (see FIG. 6B). Rewrite the information indicating the status corresponding to the file name to “minimized”.

  Further, when the share management unit 15 of the terminal 10aa acquires the file name of the window and the information returned from the minimized state to the original size, the material management table (see FIG. 6B). ), “Minimize” information indicating the state is deleted from the record in which the acquired file name is recorded.

  Further, when the share management unit 15 of the terminal 10aa obtains information indicating that the window corresponding to a certain file name has been closed, the share management unit 15 records the record in which the file name is recorded in the data management table ((B in FIG. 6). ))).

  The sharing management unit 15 of the terminal 10aa acquires the file name and information indicating the state for each record from the material management table (see FIG. 6B) updated in step S42 (step S43).

  The sharing management unit 15 of the terminal 10aa searches the sharing condition management table (see (A) of FIG. 6) using the communication ID input in step S1 as a search key, and acquires setting information and an extension (step). S44). Hereinafter, a case where the setting information “false” and the extensions “.doc, .txt, .ppt” are acquired in step S44 will be described.

  The sharing management unit 15 of the terminal 10aa determines whether the image of each active window can be shared based on the information acquired in step S44 (step S45). FIG. 12 is a flowchart illustrating an example of processing for determining whether an image can be shared. The process of step S45 will be described in detail with reference to FIG.

  The share management unit 15 of the terminal 10aa executes the following loop process for each record related to the active window acquired in step S43. First, it is determined whether the information indicating the state in the first record among the records acquired in step S43 is “minimized” (step S45-1).

  When it is determined in step S45-1 that the information indicating the state is “minimized” (YES), the sharing management unit 15 of the terminal 10aa determines the first in the material management table (see FIG. 6B). In the record, “false” indicating that sharing is not possible is recorded (step S45-3).

  When it is determined in step S45-1 that the information indicating the state is not “minimized” (NO), the sharing management unit 15 of the terminal 10aa determines the first in the material management table (see FIG. 6B). It is determined whether the extension of the file name in the record is any one of the extensions “.doc, .txt, .ppt” acquired in step S44 (step S45-2).

  If it is determined in step S45-2 that the extension of the file name in the first record is not one of “.doc, .txt, .ppt” (NO), the share management unit 15 of the terminal 10aa Then, “false” indicating that sharing is not possible is recorded in the first record of the material management table (see FIG. 6B) (step S45-3).

  If it is determined in step S45-2 that the extension of the file name in the first record is one of “.doc, .txt, .ppt” (YES), the sharing management unit 15 of the terminal 10aa Then, “true” indicating that sharing is possible is recorded in the first record of the material management table (see FIG. 6B) (step S45-4).

  When the share management unit 15 of the terminal 10aa completes the above determination process related to the first record among the records related to the active window acquired in Step S43, the remaining records acquired in Step S43 are completed. The above processing is repeated for each record. When the repetitive processing is completed, “true” or “false” is recorded in all the shareability fields in the material management table (see FIG. 6B).

  Note that the above-described method for determining whether or not to share an image is an example, and is appropriately changed based on the conditions set in step S33. For example, when only setting whether to share an image acquired from the minimized window is accepted in step S33, the process of step S45-2 in FIG. 12 is skipped. In this case, the sharing management unit 15 determines whether the image of the window can be shared based only on the condition that the window is minimized. For example, when only setting of the extension of the file is accepted in step S33, the process of step S45-1 in FIG. 12 is skipped. In this case, the sharing management unit 15 determines whether or not the window image can be shared based only on the file extension acquired from the window title. In addition to the above conditions, other conditions may be included as the determination conditions.

  When the processing in FIG. 12 is completed, the share management unit 15 of the terminal 10aa searches the display order management table (see FIG. 6C) using the communication ID input in step S1 as a search key, and displays the corresponding display. The forward condition is read (step S46). Hereinafter, a case where the read display order condition is “order in which the number of times of sharing for each partner is large” will be described.

  The sharing management unit 15 of the terminal 10aa searches the material management table using the information “true” indicating whether sharing is possible in the material management table (see FIG. 6B) as a search key, and reads out the corresponding file name (step). S47).

  The share management unit 15 of the terminal 10aa reads each file name read in step S47 (for example, “this month's target.txt” and “design specification.doc”) and the communication partner received in step S24-1. Search the sharing history management table (see (D) of FIG. 6) using the set of communication ID “01ba” of the terminal 10ba as a search key, and read out the corresponding number of sharing (for example, “5” and “2”). (Step S48).

  The sharing management unit 15 of the terminal 10aa generates a list of sharable meeting materials in which the file names read in step S47 are arranged in descending order of the number of sharing based on the sharing count read in step S48. (Step S49). The display control unit 14 of the terminal 10aa outputs the list of sharable conference materials generated in step S49 to the display 120 for display. FIG. 13 is a display example of a display including a list of conference materials that can be shared. In FIG. 13, the list of sharable meeting materials is a dialog box whose title is “Meeting Material List”.

  In step S47, the sharing management unit 15 of the terminal 10aa may read all file names and information sets indicating whether sharing is possible from the material management table (see FIG. 6B). In this case, the display control unit 14 distinguishes it from the file name associated with the information “true” indicating whether sharing is possible, for example, by graying out the file name associated with the information “false” indicating whether sharing is possible. A list of meeting materials may be generated.

  When the display order condition read in step S46 is “ID order”, the sharing management unit 15 of the terminal 10aa reads the material ID in addition to the file name in step S47. Then, the sharing management unit 15 arranges the file names so that the corresponding material IDs are in ascending order, and generates a list of conference materials that can be shared. In another embodiment, “order in which the number of times of sharing for each partner is large” and “ID order” can be used in combination as display order conditions. In this case, the sharing management unit 15 sets the priority order of “in order of the number of times of sharing for each partner” and “ID order”, and the file read in step S47 under the display order condition with the higher priority order. Line up names. For those having the same attribute value of the display order condition with high priority, the sharing management unit 15 generates a list of meeting materials by arranging the file names under the display order condition with low priority.

  When the user of the terminal 10aa performs an operation of selecting a file name of the meeting material to be shared from the list of sharable meeting materials displayed on the display 120, the input reception unit 12 of the terminal 10aa selects the meeting material to be shared. Is received (step S50). The share management unit 15 of the terminal 10aa is associated with the file name selected in step S50 and the communication ID of the communication partner received in step S24-1 in the share history management table (see FIG. 6D). Update the number of sharing times to the number obtained by adding one.

  The image acquisition unit 16 of the terminal 10aa acquires window image data by capturing an image of the window whose title is the file name selected in step S50 (step S51). For example, when the file name selected in step S50 is “current month target.txt”, the image acquisition unit 16 reads the file name “current month target.txt” from the window titled “current month target.txt”. The image data of the screen on which the content of the file “txt” is displayed is acquired.

  The transmission / reception unit 11 of the terminal 10 transmits the window image data acquired in step S51 to the relay device 30 using the session sed (step S52). When receiving the window image data, the relay device 30 transmits the received image data to the terminals 10ba participating in the same session sed (step S53).

  The transmission / reception unit 51 of the terminal 10ba receives the image data of the window transmitted by the relay device 30. The display control unit 14 of the terminal 10ba outputs the image data of the window image transmitted in the session sed and the image data of the conference participant transmitted in the session sed to the display 120 as a display device. It is displayed (step S54).

  Also in the terminal 10aa that has transmitted the window image data, the display control unit 14 displays the window image data transmitted in the session sed and the image data obtained by capturing the conference participants transmitted in the session sed. The data is output and displayed on the display 120 (step S55). Thereby, since the image data of the image of the same window is displayed on the terminal 10aa and the terminal 10ba, the conference material can be shared between the terminal 10aa and the terminal 10ba.

<< Main effects of embodiment >>
According to the image sharing method of the above-described embodiment, the terminal 10aa displays the selected window from among one or more windows (an example of a display area) for displaying an image by an application such as an active viewer on the terminal 10aa. By transmitting the image data to the other terminal 10ba, the image is shared with the other terminal 10ba. The input receiving unit 12 (an example of a receiving unit) of the terminal 10aa receives an input of a condition for sharing an image with another terminal 10 (an example of a receiving process). Based on the conditions received by the input receiving unit 12, the sharing management unit 15 (an example of a generation unit) of the terminal 10aa generates a conference material indicating a window for displaying a sharable image among one or more windows. A list (an example of a list) is generated (an example of a generation process). The transmission / reception unit 11 (an example of a transmission unit) of the terminal 10aa transmits the image data of the window selected from the list to another terminal 10ba (an example of a transmission process). According to the terminal 10aa, an image that is not sharable can be prevented from being transmitted to another terminal 10ba by selecting an image from a list showing sharable images among the images of the window in the terminal 10aa.

  The input receiving unit 12 of the terminal 10aa receives an input of a condition that the minimized window image is not a sharable image. Thereby, when the terminal 10aa cannot acquire the image data including the content from the minimized window, the terminal 10aa can be prevented from transmitting the image data not including the content to the terminal 10ba.

  The input receiving unit 12 of the terminal 10aa receives an input of a condition that enables sharing of an image generated from a file with a predetermined extension. Thereby, when only an image generated from a file with a predetermined extension can be shared, the terminal 10aa can prevent an image that cannot be shared from being transmitted to the terminal 10ba.

  The sharing history management DB 1004 (an example of a management unit) of the terminal 10aa manages the number of times an image generated from this file is shared for each file. The share management unit 15 of the terminal 10aa generates a list in which file names (an example of information) corresponding to this file are arranged in order of the number of times managed in association with the file in the share history management DB 1004. Accordingly, the terminal 10aa can cause the user to select an image to be shared from a list in which file names are arranged in the order of the selected number of times.

  The sharing history management DB 1004 of the terminal 10aa may manage the number of times an image generated from this file is shared for each file and communication ID of another terminal 10. The share management unit 15 of the terminal 10aa is a list in which information indicating the file name corresponding to the file is arranged in the order of the number of times managed in association with the communication ID of the file and the other terminal 10 in the share history management DB 1004. Is generated. Thereby, the terminal 10aa can cause the user to select an image to be shared from a list of conference materials in which file names are arranged in the order of the selected number of times.

<< Supplement of Embodiment >>
The program for the terminal 10 may be recorded and distributed on a computer-readable recording medium using an installable or executable file. Other examples of the recording medium include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), and Blu-ray Disc. The recording medium or an HD (Hard Disk) in which these programs are stored can be provided domestically or abroad as a program product.

  In addition, the terminal 10 and the management system 50 in the above embodiment may be configured by a single device, or may be configured by a plurality of devices that are arbitrarily assigned by dividing each unit (function or means). Also good. For example, at least some of the functions of the sharing management unit 15, the sharing condition management DB 1001, the material management DB 1002, the display order management DB 1003, and the sharing history management DB 1004 of the terminal 10 may be provided in the management system 50. In this case, the terminal 10 transmits information used for executing at least a part of functions provided in the management system 50. The management system 50 executes processing by at least some functions based on the received information, and transmits the processing result to the terminal 10.

  For example, the terminal 10 transmits the condition input in step S <b> 32 to the management system 50. The management system 50 may manage the conditions received from the terminal 10 in the sharing condition management DB 1001 and the display order management DB 1003 provided in the management system 50. For example, the terminal 10 transmits the list request input in step S <b> 41 to the management system 50. In response to the list request, the management system 50 may generate a list of conference materials by processing similar to steps S <b> 42 to S <b> 49 and send the generated list of conference materials to the terminal 10. The management system 50 may be provided with a WEB service and accept the request from the terminal 10 on the WEB.

  Each function of the embodiment described above can be realized by one or a plurality of processing circuits. Here, the “processing circuit” in this specification refers to a processor programmed to execute each function by software, such as a processor including an electronic circuit, or an ASIC designed to execute each function described above. It includes devices such as (Application Specific Integrated Circuit) and conventional circuit modules.

DESCRIPTION OF SYMBOLS 1 Communication system 2 Communication network 10 Terminal 11 Transmission / reception part 12 Input reception part 14 Display control part 15 Share management part 16 Image acquisition part 19 Storage / reading part 30 Relay apparatus 50 Management system 51 Transmission / reception part 52 Authentication part 53 Terminal management part 54 Session Management unit 59 Storage / reading unit 1000 Storage unit 1001 Shared condition management DB
1002 Data management DB
1003 Display order management DB
1004 Shared history management DB
5000 storage unit 5002 authentication management DB
5003 Terminal management DB

JP 2012-160025 A

Claims (10)

In the communication terminal, the image of the selected display area among one or more display areas for displaying the image by the running application is transmitted to the other communication terminal, so that the other communication terminal and the image are displayed. A communication terminal to share,
Receiving means for receiving an input of a condition for sharing the image with the other communication terminal;
Generating a list indicating a display area for displaying a sharable image among one or more display areas for displaying an image by the running application based on a condition received by the receiving unit Means,
Transmitting means for transmitting an image of a display area selected from the list to the other communication terminal;
A communication terminal.   The communication terminal according to claim 1, wherein the reception unit receives an input of a condition that the image of the minimized display area is not set as the shareable image.   The communication terminal according to claim 1, wherein the receiving unit receives an input of a condition that enables sharing of an image generated from a file with a predetermined extension. Management means for managing the number of times an image generated from the file is shared for each file;
The communication terminal according to claim 3, wherein the generation unit generates a list in which information indicating display areas corresponding to the file is arranged in order of the number of times managed by the management unit in association with the file. The management means manages the number of times an image generated from the file is shared with the other communication terminal for each identification information of the file and the other communication terminal,
The generation unit generates a list in which information indicating a display area corresponding to the file is arranged in order of the number of times managed by the management unit in association with the identification information of the file and the other communication terminal. The communication terminal according to claim 4. A communication terminal according to any one of claims 1 to 5;
The other communication terminal,
The communication terminal and the other communication terminal output an image of the display area to a display device. In the communication terminal, the image of the selected display area among one or more display areas for displaying the image by the running application is transmitted to the other communication terminal, so that the other communication terminal and the image are displayed. To the communication terminal to share,
A reception process for receiving an input of a condition for sharing the image with the other communication terminal;
Based on the conditions accepted by the acceptance process, a list indicating a display area for displaying the sharable image is generated from one or more display areas for displaying an image by the running application. Generation process,
A transmission process for transmitting an image of a display area selected from the list to the other communication terminal;
Image sharing method to execute. The communication terminal is
Management means for managing the number of times an image generated from the file is shared for each file;
The image sharing method according to claim 7, wherein the generation process generates a list in which information indicating display areas corresponding to the file is arranged in order of the number of times managed by the management unit in association with the file. In the communication terminal, the image of the selected display area among one or more display areas for displaying the image by the running application is transmitted to the other communication terminal, so that the other communication terminal and the image are displayed. To the communication terminal to share,
A reception process for receiving an input of a condition for sharing the image with the other communication terminal;
Based on the conditions accepted by the acceptance process, a list indicating a display area for displaying the sharable image is generated from one or more display areas for displaying an image by the running application. Generation process,
A transmission process for transmitting an image of a display area selected from the list to the other communication terminal;
A program that executes The communication terminal is
Management means for managing the number of times an image generated from the file is shared for each file;
The program according to claim 9, wherein the generation process generates a list in which information indicating display areas corresponding to the file is arranged in order of the number of times managed by the management unit in association with the file.

Images