JP6802477B2 - Information processing system, information processing device, its control method and program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, a control method and a program thereof.

Conventionally, in a web conferencing system, devices having functions such as a camera, a microphone, and a speaker are connected to an information processing device such as a personal computer or a tablet terminal, and video and audio input from each device are transmitted between a plurality of bases. Sending and receiving.

In a remote desktop such as Virtual Network Computing (VNC), the screen of another computer connected by a network is shared or operated from the computer at hand. In addition, one of the user terminals participating in the web conference becomes the host terminal, and the entire desktop of the host terminal or the image of a specific application is shared with the guest terminal which is the user terminal of another participating user. (For example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2011-1920 Japanese Unexamined Patent Publication No. 2013-029922

Patent Document 2 describes that a list of application windows is displayed and the screen of an application selected from the list is shared among a plurality of terminals. However, it is troublesome to display the application window list screen each time the screen sharing is started, select the application window to be shared, and perform the sharing start operation. On the other hand, when the desktop screen is shared, the images of all the windows displayed on the desktop screen are shared, which has the effect of saving the trouble of displaying the application window list and selecting from the list. Even the extra information displayed on the screen that is not necessary for the meeting will be shared.

An object of the present invention is to facilitate selection of a display image to be shared by a plurality of terminals and to provide a mechanism for sharing a necessary image with each terminal.

The present invention is an information processing apparatus including a sharing means for sharing a designated display image among a plurality of client terminals, a specific means for specifying an active window and a designation means for designating an image of the active window as the display image. And the determination means for determining the display image which is the image of the designated active window as the display image to be shared by the sharing means when the display image is designated by the designation means. The sharing means is characterized in that a display image, which is an image of the active window determined by the determination means, is shared by the plurality of client terminals.

According to the present invention, it is possible to easily select a display image to be shared by a plurality of terminals and provide a mechanism for sharing a necessary image with each terminal.

It is a figure which shows an example of the structure of the information processing system in 1st Embodiment of this invention. It is a figure which shows an example of the hardware composition of various devices in 1st Embodiment of this invention. It is a figure which shows an example of the functional structure of various devices in 1st Embodiment of this invention. It is a flowchart which shows the flow of the conference image transmission processing in 1st Embodiment of this invention. It is a flowchart which shows the flow of the display image sharing processing in 1st Embodiment of this invention. It is a flowchart which shows the flow of the change processing of the shared display image in 1st Embodiment of this invention. It is a figure which shows an example of various data structures in 1st Embodiment of this invention. It is a figure which shows an example of the structure of the conference screen and the application window list in the 1st Embodiment of this invention. It is a figure which shows an example of the structure of the display screen of each terminal with the change of the active window in 1st Embodiment of this invention. It is a figure which shows an example of the structure of the display screen of each terminal according to permission / non-permission of sharing of a display image in 1st Embodiment of this invention. It is a figure which shows an example of the structure of the display screen of a host terminal accompanying the change of the active window by starting an application in 1st Embodiment of this invention. It is a figure which shows an example of various data structures in another embodiment of this invention.

In the embodiment of the present invention, in the display image on the screen (for example, the image of the application window), the display image shared with other terminals participating in the web conference is displayed according to the application window displayed on the desktop screen. The mechanism for easily determining and sharing will be explained.

In addition, for example, by maximizing the application window that was minimized on the desktop screen due to an erroneous operation by the host user or a remote operation by the guest user, multiple images of the application window that the host user does not intend to share the display are displayed. It is necessary not to share it on the terminal.

Therefore, in the embodiment of the present invention, the display image to be shared with other terminals participating in the web conference is easily determined from the display images on the screen according to the application window displayed on the desktop screen. In addition, the method of permitting / disallowing the sharing of the displayed image will also be described.

Hereinafter, an example of the embodiment of the present invention will be described with reference to the drawings.

<First Embodiment>
First, with reference to FIG. 1, an example of the configuration of the information processing system according to the first embodiment of the present invention will be described.

The web conferencing system of the present invention is, for example, a client terminal 100 (100H, 100G1, 100G2) which is an information processing device to which a personal computer can be applied, and a web conferencing server 200 (server) that enables the web conferencing system to be used on each client terminal. A device (one of the information processing devices)) is communicably connected and configured via the network 150.

The web conference server 200 is a server for realizing a web conference using a web browser, and is a conference in which a user with a user ID who has received input from each client terminal 100 participates in response to an access from the client terminal 100. A web conference screen (interface / information for displaying a screen represented by, for example, html), which is a screen, is transmitted to each client terminal 100 and displayed. By providing the conference screen (providing the conference image and the display image to be displayed on the conference screen), a service for conducting a web conference by a plurality of client terminals 100 is provided.

The conference image referred to here is an image captured by the camera of each client terminal 100 (for example, the camera 101 of FIG. 1) in which the user ID of the user participating in the conference is input and transmitted to the web conference server 200. It is a certain captured image, for example, an image of a user's own face. Further, the display image referred to here is an image transmitted and shared from the client terminal 100 to the web conferencing server 200, which has received the designation according to the user operation via the input unit of the client terminal 100.

The display image is an image displayed on the display screen of the client terminal 100, for example, which is determined to be shared with another client terminal 100 by accepting a designation by a user operation on the client terminal 100. The display image is, for example, a desktop image displayed on the desktop screen of the client terminal 100. Alternatively, it is an image of the application window displayed on the desktop that has been specified by the user. In the present embodiment, the operation of activating the application window or displaying it in the foreground on the desktop screen is an operation of designating a display image to be shared with each terminal by the user. The display image is transmitted from the client terminal 100 (the host terminal that is the sharing source terminal of the display image) to the web conference server 200, which is the host of the sharing process, and the web conference server 200 is participating in the same conference as the host terminal. It is transmitted to another client terminal (guest terminal that is the terminal to share the displayed image).

The client terminal 100 is, for example, a desktop PC as shown in 100H, a notebook PC as in 100G1, and a tablet PC as in 100G2. The client terminal 100 displays an image or video (meeting image) or a display image also received from the web conferencing server 200 on the conference screen received from the web conferencing server 200.

In the present embodiment, it is assumed that the client terminal 100 is installed with a web browser for accessing the web conference server 200 and a dedicated module. The dedicated module is, for example, an ActiveX component downloaded from the web conferencing server 200 via a web browser. When transmitting a moving image of itself in a web conference, a camera 101 (such as a webcam), which is a video device, is connected. When transmitting voice, a microphone 102 is connected, and in order to view the voice of the other party, a speaker 103 is connected. The microphone 102 and the speaker 103 are audio devices.

Further, although each device is illustrated as a separate housing in FIG. 1, for example, a device in which 101 to 103 are provided in hardware of the same housing may be used. For example, it is a device having a camera function and a microphone function, a microphone function and a speaker function, and all functions. Further, when the devices 101 to 103 are built in the client terminal 100, the built-in devices may be used to input / output images, sounds, and the like.

In the web conferencing system of the present embodiment, an image (display image) of the screen displayed on the client terminal 100 (example: client terminal 100H) is displayed on the screen of another client terminal 100 (example: client terminals 100G1, 100G2, etc.). Displaying and screen sharing (display sharing processing of displayed images) can be performed. The shared display image can be specified on the client terminal 100. For example, only the screen (window image) of the application specified by the user operation can be shared as the display image (application sharing). Further, by accepting the designation of the desktop screen displayed on the client terminal 100, the entire desktop image can be shared as a display image (desktop sharing). Further, by designating the client terminal 100 (or by accepting the operation of displaying the image captured by the camera of the own device in full screen), the image captured by the camera can be shared as the display image. The client terminal 100 of the sharing source of the display image that has started sharing the display image is used as the host terminal, and the other client terminal 100 of which the display image is shared is used as the guest terminal.

Further, this web conferencing system can generate, store, and manage a plurality of virtual conference rooms called rooms on the web conference server 200. A user who operates each client terminal 100 accesses the web conferencing server 200 via a web browser using his / her own user ID / password, logs in, and enters the room using his / her own user ID. You can participate in the conference held in the room. The above is the description of FIG.

Hereinafter, an example of the hardware configuration of the web conferencing server and the client terminal in the first embodiment of the present invention will be described with reference to FIG.

In FIG. 2, 201 is a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a function executed by a BIOS (Basic Input / Output System) or an operating system program (hereinafter, OS) which is a control program of the CPU 201, and each server or each PC. Various programs described later are stored.

Reference numeral 203 denotes a RAM, which functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing a process from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

Reference numeral 205 denotes an input controller, which controls input from a pointing device such as a keyboard (KB) or a mouse (not shown), or an input device 209 such as a touch panel or a camera.

Reference numeral 206 denotes a video controller, which controls display on a display (external output device) such as a display device 210 (eg, CRT display). The display device shown in the display device 210 may be not only a CRT display but also another display such as a liquid crystal display or a multi-touch screen. Further, it may be an external output device such as a projector.

The video controller 206 can control a video memory (VRAM) for display control, a part of the RAM 203 can be used as a video memory area, or a dedicated video memory may be provided separately. It is possible. In the present embodiment, each client terminal 100 displays a first video memory area used for display when the client terminal 100 is normally displayed, and a first video memory area when a predetermined screen is displayed. It has a second video memory area that is used to display another display on top of the content. The video memory area is not limited to two, and it is possible to have a plurality of video memory areas as long as the resources of the information processing device allow.

Reference numeral 212 denotes an audio input / output controller, which controls input / output from the microphone / speaker 213 (102 and 103 in FIG. 1). It is possible to recognize the voice input from the microphone. Earphones can also be connected to the speaker.

Reference numeral 207 is a memory controller, which is connected to a hard disk (HD) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA card slot via an adapter. It controls access to an external memory 211 such as a compact flash (registered trademark) memory.

Reference numeral 208 denotes a communication I / F controller, which connects and communicates with an external device via a network (for example, network 150 (for example, LAN or the like) shown in FIG. 1), and executes communication control processing in the network. .. For example, communication using TCP / IP, communication using a telephone line such as ISDN, and communication using a 3G line of a mobile phone are possible.

The CPU 201 can display the outline font on the CRT 210 by executing the outline font expansion (rasterization) process in the display information area in the RAM 203, for example. Further, the CPU 201 enables a user instruction with a mouse cursor (not shown) displayed on the display device 210.

Further, the storage device (storage medium) for permanently storing information such as the external memory 211 is not limited to a storage device such as a hard disk. For example, it may be a medium such as SSD (Solid State Drive).

Various programs described later for realizing the present invention are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as needed. Further, a definition file and various information tables used when executing the above program are also stored in the external memory 211, and detailed description of these will be described later. The above is the description of FIG.

Next, with reference to FIG. 3, an example of the functional configuration of various devices according to the first embodiment of the present invention will be described.

The client terminal 100 includes an image storage unit 311, a transmission control unit 312, a permission information storage unit 313, an active window change instruction reception unit 314, a transmission stop control unit 315, a selection screen display control unit 316, a display control unit 317, and the like. There is.

The web conferencing server 200 includes a conference information storage unit 321, a reception control unit 322, an image storage unit 323, a transmission control unit 324, and the like.

The conference information storage unit 321 is a storage unit that stores which user has entered which conference room and is having a conference with which user.

The transmission control unit 312 displays an image (video) captured and input by the camera or a display image (an image of the entire desktop or the screen of a specified application) designated as an image to be shared by a user operation or the like on a web conference server. It is a transmission control unit that controls transmission to the desktop. The transmitted image is received by the reception control unit 322 of the web conferencing server 200 and stored in the image storage unit 323 (queue) on the memory.

The image storage unit 311 is a storage unit (queue) that stores the same image as the image transmitted by the transmission control unit 312. The queue includes a queue for captured images (conference images) captured by the imaging device of the client terminal 100 and a queue for display images (images of the desktop screen of the client terminal 100, etc.) designated by user operation.

Captured images are sequentially stored in the queue for captured images. Since the camera continuously performs imaging processing (capturing a moving image and inputting a moving image to the client terminal 100), a plurality of images constituting the moving image are sequentially stored in the queue for each frame in the moving image. .. The display image is stored in the display image queue at predetermined time intervals. For example, every 0.2 seconds, the desktop image displayed on the desktop screen of the client terminal 100 is sequentially stored. Each stored display image is, for example, one frame of a moving image in which desktop images are joined and reproduced.

The reception control unit 322 is a reception unit that receives the conference image (video), the display image, and the sound transmitted from the transmission control unit 312 of the client terminal 100. The transmission control unit 324 uses the image, display image, sound, etc. received by the reception control unit 322 as the client of the transmission source of the image or sound, which is participating in the same conference (in the same conference room). Another control unit that transmits to another client terminal 100 for reception.

In the present embodiment, each client terminal 100 requests the web conference server 200 to acquire an image from the image storage unit 323, and the transmission control unit 324 of the web conference server 200 responds to the request. Sends the latest image in the queue at the time of receiving the request to the requesting client terminal 100. After receiving the requested image, the client terminal 100 displays the received image (one frame in the moving image) on the display screen. Then, in parallel with the display, the next image in the moving image is requested from the web conferencing server 200. The request and display of the image are repeated until the display of the moving image is completed, such as the end of the meeting.

The transmission control unit 324 is a control unit that transmits a conference image or a display image stored in the image storage unit 323 to the request source client terminal 100 in response to a request from each client terminal 100.

The active window change instruction reception unit 314 is a reception unit that receives an active window change instruction by a user operation or the like. The change instruction of the active window is, for example, a mouse click operation (an operation of displaying in the foreground of the desktop screen) for a window different from the application window currently displayed in the foreground on the desktop screen. For example, when it is detected that the OS has issued an event indicating that the operation for changing the active window has been accepted, it is determined that the instruction for changing the active window has been accepted.

The transmission stop control unit 315 is a control unit that suspends transmission (sharing) of the changed active window image (display image) to the web conference server 200 when the active window change instruction is received.

When the selection screen display control unit 316 receives the instruction to change the active window, does the selection screen display control unit 316 share the image of the application window that has received the newly activated instruction with other client terminals 100 participating in the same conference? It is a processing unit that displays and controls a selection screen (a specification screen to be specified by the user) that allows the user to select whether or not (whether sharing is permitted or not permitted).

The permission information storage unit 313 is a storage unit that stores the identification information of the application window selected to allow sharing, the application window not yet permitted, and the application window selected not to be permitted on the selection screen.

The display control unit 317 is an image (video / video) input from the camera, an image of the entire desktop designated as an image shared between a plurality of client terminals, or an image of the screen displayed in the designated application window. Is a control unit that displays on the display screen. Further, the image (conference image or display image) transmitted by the transmission control unit 324 is received, the received image is stored in the queue for the received image (image storage unit 311) on the memory, and the queue on the memory is stored. Images are sequentially acquired from the image, continuously displayed on the display screen, and reproduced and displayed as a moving image. The above is the description of FIG.

Next, with reference to FIG. 4, the flow of the image transmission process in the first embodiment of the present invention will be described.

The CPU 201 of the client terminal 100 accesses a predetermined URL according to a user operation on the browser software in order to enjoy the web conferencing service provided by the web conferencing server 200, and displays a login screen (not shown). Then, by accepting the input of the user ID and password on the login screen and accepting the pressing of the "login" button, the login request to the web conference server 200 is transmitted (step S401).

The CPU 201 of the web conferencing server 200 receives the login request (step S402), matches the user information (user ID and password / illustrated in 700 in FIG. 7) stored in advance in the external memory of the own device, and performs an authentication process (exemplified in 700 in FIG. 7). Login process). When the authentication is successful (when the login to the web conferencing server 200 using the received user ID is successful), the screen information (for example, html information) of the menu screen (not shown) is generated and transmitted to the client terminal 100. (Step S403).

The CPU 201 of the client terminal 100 receives the screen information and displays a menu screen (not shown) on the display screen based on the received screen information (step S404). The CPU 201 of the client terminal 100 accepts a room selection operation for a logged-in user to enter in a room (room identification information) selection unit (not shown) included in the menu screen (step S405), and is included in the same screen. By accepting the pressing of the illustrated "entering room" button, the entry request to the selected room is transmitted to the web conference server 200 (step S406).

The CPU 201 of the client terminal 100 responds to the entry request by the user ID of the logged-in user who is logged in by the client terminal 100 that has received the entry operation, the identification information (room ID) of the room to be entered, and the identification information of the client terminal 100 (room ID). The request is transmitted to the web conference server 200, including information such as the IP address), the terminal type of the client terminal 100, and the communication method. The terminal type is information for identifying, for example, whether the client terminal 100 itself is a PC (desktop PC, notebook PC) or a mobile terminal (for example, a tablet PC, a mobile phone, etc.). If the own device is a PC, the value of terminal type = pc is transmitted, and if the own device is a mobile terminal, the value of terminal type = mobile is transmitted. Each client terminal 100 holds and stores information on the terminal type of its own device in advance in a storage area such as an external memory of its own device, and acquires the information and embeds it in the request. The communication method is identification information of the communication method indicating how the client terminal 100 itself communicates with the web conference server 200. For example, in the case of communication using a wired LAN, the communication method = wireless-line, and in the case of wireless communication, the communication method = wireless. The CPU 201 of the client terminal 100 inquires of the functional unit (for example, communication / IF controller) that manages the communication of the own device about the communication method used by the own device for communication with the external device, and acquires the information of the communication method. To do. Then, it is embedded in the room entry request and transmitted to the web conference server 200.

Here, by including the room selected by the client terminal 100 in the entry request, the web conferencing server 200 acquires the room ID of the room for which the entry request and the entry request have been made. For example, the room to enter. When the selection operation of is accepted, the ID of the room is transmitted to the web conference server 200 as the ID of the selected room, the web conference server 200 accepts this, and the pressing of the "enter" button is accepted to select. A user who is logged in by the client terminal 100 may be requested to enter the room, and the web conferencing server 200 may accept this.

When the CPU 201 of the web conferencing server 200 receives the entry request (step S407), it executes an entry process for allowing the user to enter the requested room (meeting room) (step S408).

Here, in the room entry process, it is registered and stored which user enters the room by communicating with which conference in which conference room, which terminal of what terminal type, and by what communication method.

Specifically, the room ID of the room entering the conference room 711 of the conference information 710 of FIG. 7 and the user ID of the user who enters the participant ID 713 are added. If there is no user in the room (when entering an unmanned room), a conference ID that identifies the conference is issued, inserted and stored in the conference ID 712. In the case of a second person or later, the conference ID (meeting ID corresponding to the room being entered) of the conference in which the user ID (participant) who is in the same room is participating shall be stored in the conference ID 712. Further, the terminal ID of the client terminal 100 included in the entry request received in step S407 is inserted into the terminal ID 714. In the first embodiment, the received terminal type and communication method information is not stored. (In other embodiments described later, for example, the terminal type is inserted into the terminal type 1215 and the communication method is inserted into the communication method 1216 and stored.)

When the entry process is completed, the CPU 201 of the web conferencing server 200 displays screen information (for example, html information) of the conference screen displaying the conference image captured by the camera of each client terminal 100 as shown in 800 of FIG. It is transmitted to the client terminal 100 of the transmission source of the user ID of the user who entered the room (step S409).

The CPU 201 of the client terminal 100 receives the screen information of the conference screen and displays the conference screen 800 based on the received screen information (step S410). After that, the processes of steps S411 to S423 are executed and continued until the end of the meeting (the end of the meeting will be described later in step S424).

The CPU 201 of the client terminal 100 receives an input of an image (video) from the camera 101 connected to the own device (or built in the own device), and the image (video / conference image) captured by the camera 101. Is acquired (step S411) and displayed on the conference screen (step S412). For example, in the display area 804 of the conference screen 800 of FIG. 8, an image captured by the camera of the own device is displayed. In FIG. 8, 801 is a main display area for displaying a large image, and 802, 803, and 804 are sub display areas for displaying a small image. Further, 805 is an "application sharing button" for displaying a list of display images (eg, an image of an application window) shared with another client terminal 100 participating in the same conference.

While the CPU 201 of the client terminal 100 displays the input image (video) from the camera 101 on the conference screen, the image (video) is compressed by the video codec, and the compressed image is sequentially displayed frame by frame. Each is saved and stored in a queue on the memory of the own device (step S413).

An example of the queue is shown in the conference image queue 720 of FIG. The conference image queue 720 is an identification number (identification information) of each image, a sequence number 721 indicating the order of the images, and an item of the image 722 which is the actual image (image data / one frame image in the video). Consists of. The CPU 201 of the client terminal 100 assigns sequence numbers to the images of each frame of the video acquired from the camera 101 in the order in which the images are acquired, and stores them in the conference image queue 720.

The CPU 201 of the client terminal 100 sequentially transmits the images stored in the conference image queue 720 to the web conference server 200 together with the sequence number (step S414). That is, the information shown in the conference image queue 720 is transmitted to the web conference server 200.

The CPU 201 of the web conference server 200 receives the image (compressed data) (step S415) and holds it in the memory of its own device, and is a login user at the client terminal 100 (terminal ID 714) that is the source of the image. It is added to and stored in the conference image queue (the configuration is the same as that of the conference image queue 720) (step S416). The CPU 201 of the web conference server 200 generates a conference image queue for each user (for each user ID of the user who entered the participant ID 713 in the conference room) when the user enters the conference room. And keep it in memory. In the conference image queue on the memory of the web conference server, the same information as the sequence numbers 721 and image 722 of the conference image queue 720 received from the client terminal 100 is stored in association with each other.

In step S417, the CPU 201 of the client terminal 100 transmits a request for acquiring an image of another conference participant (an image of the conference image queue of the user ID of another occupant who is in the same room) to the web conference server 200. (Step S417). The request shall include a user ID logged in to the web conferencing server 200 on the client terminal 100.

The CPU 201 of the web conference server 200 receives the acquisition request (step S418), and sets the user ID of a user who is in the same room as the logged-in user other than the logged-in user at the requesting client terminal 100 (terminal ID 714). It is specified by referring to the conference information 710. Then, among the images of the conference image queue of the other identified occupants, the image of the latest sequence number (latest number) is acquired (step S419), and the image captured by the camera of each of the acquired client terminals 100 is acquired. (Meeting image) is transmitted to the requesting client terminal 100 together with the user ID corresponding to the image (step S420).

The CPU 201 of the client terminal 100 receives the image (compressed data) transmitted in step S420 (step S421), performs decompression processing by the video codec to restore the video (image), and displays it on the conference screen being displayed. (Step S422). For example, in 800 of FIG. 8, the main display area 801 is assigned an image (video) of User 002, and the sub display areas such as 802 and 803 are assigned images (video) of User 003 and User 004. Further, an image (video) of User001 itself, which is a login user, is assigned to 804. It is assumed that the association information (information in which the ID of the display area and the user ID are associated) for displaying the image of which user in which display area is stored in the memory of the client terminal 100. The CPU 201 of the client terminal 100 updates the display of each user's image (meeting image) by displaying the received image in the display area corresponding to the user of each image, and reproduces the received image as a moving image (video). indicate.

The CPU 201 of the client terminal 100 determines whether the conference has ended (step S423). For example, when the client terminal 100 accepts the pressing operation of the "exit button" (not shown), it is determined that the conference has been completed for the logged-in user. If the end time of room use is stored in the web conferencing server, the CPU 201 of the web conferencing server 200 forcibly terminates the web conferencing at the end time, and participates in the forcibly terminated conference. Notify the client terminal 100 of the existing user. When the CPU 201 of each client terminal 100 receives the notification of the forced termination, it determines that the conference has ended. When the web conference is completed, the process of FIG. 4 is terminated, and when it is continuing, the process proceeds to step S411.

When conducting a web conference, there may actually be a plurality of client terminals 100. Therefore, the CPU 201 of the web conference server 200 executes steps S402 to S409 for the number of client terminals 100 logged in to the web conference server 200. Will be done. Further, the processes of steps S415 to S420 are executed for the number of client terminals 100 of the users who participated in the web conference (entered the room). The above is the description of FIG.

Next, with reference to FIG. 5, the flow of the display image transmission processing in the first embodiment of the present invention will be described.

In the description of the present embodiment, the active window (the application window displayed in the foreground on the desktop screen) is a display image designated to be shared with other client terminals participating in the same conference. In addition, when the operation to activate the application window is accepted, the operation to select (specify) the image of the application window to be activated as the display image to be shared with other client terminals participating in the same conference is accepted. It shall be judged.

The CPU 201 of the client terminal 100H receives a display instruction on a display image selection screen that allows sharing with other client terminals, or a designation and sharing instruction of the display image (step S501). For example, when the press of the "full screen" button on the conference screen of FIG. 8 is accepted, the image is being transmitted to the web conference server 200 captured by the camera 102 of the client terminal 100H that accepts the press of the "full screen" button. The conference image is determined as the display image, and it is determined that the instruction to share the display image has been accepted.

Further, for example, by accepting the pressing of the "application sharing" button 805 on the conference screen of FIG. 8, an application window that allows sharing of the display with other client terminals as shown in the selection screen 811 of 810 of FIG. 8 is displayed. It is determined that the display instruction of the selection screen to be selected (the specification screen to be specified) has been accepted.

In the present embodiment, it is assumed that the client terminal 100H of the sharing source (transmitting source) of the displayed image is a host terminal, and the client terminals 100G1 and 100G2 of the sharing destination (transmitting destination) are guest terminals. Further, in step S501, it is assumed that the "application sharing" button 805 of the client terminal 100H is pressed.

The CPU 201 of the client terminal 100H requests the OS (operating system) of its own machine to list the windows of the running application (list of window IDs) by accepting the pressing of the "application sharing" button 805. In response to the request, a list of application windows running on the client terminal 100H is acquired from the OS, and the list is displayed in a selectable list on the selection screen shown in 811 of FIG. It is assumed that each window is given a unique window ID by the OS. The window ID is, for example, unique identification information indicating which window of which application. When the window ID = App001_win001, it indicates that the window 001 of the application 001.

The CPU 201 of the client terminal 100H accepts a selection operation of an application window that allows sharing. On the selection screen 811, a plurality of application windows can be selected as windows for which sharing is permitted. A check mark is displayed in the check box of the application window that accepts the selection operation so that the selected operation can be identified.

811 in FIG. 8 indicates that the application windows of "application 001_window 001" and "application 002_window 001" are selected. When the "desktop" selection operation is accepted, it is determined that the user wants to share the entire desktop image, and the application window other than the "desktop" is grayed out and displayed so that it cannot be selected. Also, if any of the application windows other than "Desktop" is selected, it is determined that the user wants to share only the image of the specific application window, and the selection part of "Desktop" cannot be selected. Gray out to.

The CPU 201 of the client terminal 100H accepts the pressing of the "OK" button on the selection screen 811 to determine the application window selected on the selection screen 811 as the application window for which sharing is permitted (step S504), and the sharing is permitted. Start the process of sharing the image of the application window. Actually, among the application windows that are allowed to be shared, the image of the active window specified in step S507 described later is shared. Further, the list of the application windows that are allowed to be shared and the list of the application windows that are not decided to be allowed to be shared (unauthorized) are stored in the memory (step S505). For example, the permission information 740 of FIG. 7 is generated.

The permission information 740 is information for storing which window ID 741 the image of the application window of the application window is permitted to be shared (viewing permission to the sharing destination user). "Allow" (= a value indicating a state in which sharing of an image to another client terminal is permitted) is stored in the application sharing permission 742 of the application window selected as allowing sharing on the selection screen 811. .. In addition, the sharing permission 742 of the application window that has been started but was not selected / specified as the application window that is allowed to be shared indicates "not permitted" (= whether or not to allow sharing is undecided). Value) is memorized. The timing at which "not permitted" (= a value indicating a state in which sharing is not permitted) is stored will be described later.

The CPU 201 of the client terminal 100H displays the desktop screen on the display screen (step S506), and is displayed in the foreground on the desktop among the application windows (sharing permission 742 = "permission" window) for which sharing is permitted. The window ID of the existing application window (active window) is inquired to the OS, specified and acquired, and stored in the memory (step S507). Specifically, a table like the active window 750 of FIG. 7 is created in the memory, and the ID of the active window is inserted and stored.

For example, a desktop screen as shown in 900 in FIG. 9 is displayed. In 900 of FIG. 9, two applications, application 001 (application ID = App001) and application 002 (application ID = App002), have already been started. Then, the window 902 (window ID = App001_win001) of the application 001 and the window 903 (window ID = App002_win001) of the application 002 are expanded and displayed. In 900 of FIG. 9, it is assumed that the window 902 is displayed as the active window.

Note that application 003 (application ID = App003) is running, and the window (window ID = App003_win001) is minimized and displayed (906). Reference numerals 904 and 905 are minimization instruction receiving units corresponding to the window of application 001 and the window of application 002, respectively. The mouse cursor 907 is in a state where the cursor is placed on the 907 in order to expand the minimized application 003 on the screen.

The CPU 201 of the client terminal 100H acquires an image of the screen of the active window indicated by the ID stored in the active window 750 (example: the image of the window 902 in FIG. 9) from the VRAM (memory) and puts it on a predetermined memory. The acquired display image 732 of the active window is stored in the image queue for the display image (queue generated in the memory of the client terminal 100H / display image queue 730 of FIG. 7) in association with the sequence number 731, and stored in the queue. The latest stored display image is acquired and transmitted to the web conference server 200 (step S508). In addition, the user ID logged in on the client terminal 100H is also transmitted to the web conference server 200.

After that, the process of changing the application window sharing the image display shown in step S519 is executed. Details of the process in step S519 will be described later in the description of FIG.

The CPU 201 of the web conferencing server 200 receives the display image transmitted in step S508 (step S509). The CPU 201 of the web conference server 200 is informed that the sharing of the display image is started by inputting the user ID of the user (example: User002, User003) who is participating in the same conference as the user of the client terminal 100H (example: User001). The user ID is transmitted to another client terminal 100 (example: 100G1, 100G2) used for logging in to the web conference server 200 (step S510). Here, the client terminal 100G1 will be described as an example. If the display image is already being shared, the process of step S510 is skipped and the process shifts to step S511.

The CPU 201 of the web conference server 200 generates and stores a display image (an image of an active window in a host terminal) in the memory of its own device and an image queue for the display image (same data as the display image queue 730) in the memory. (Step S511). Specifically, in addition to the display image for each frame and the sequence number indicating the frame of each display image, the user ID of the user of the client terminal 100H, which is the source of the display image, and the guest who has already transmitted the display image. Memorize the sent user who is the user of the terminal.

When the CPU 201 of the client terminal 100G1 receives the notification of the start of sharing the display image (step S512), the CPU 201 of the client terminal 100G1 sends a request for acquiring the display image to the web conference server 200 in order to acquire the display image from the display image queue on the web conference server. Transmit (step S513). It should be noted that the request for acquiring the display image is continued until it is determined that the operation to end the sharing of the display image has been performed in step S520 described later and the notification of the end of sharing is received from the web conference server 200.

The CPU 201 of the web conferencing server 200 receives the acquisition request of the display image (step S514), and displays the display image of the latest sequence number (example: last number) stored in the display image queue for the display image. It is acquired (step S515) and the display image is transmitted to the requesting client terminal 100G1 (step S516). At this time, the display image to be transmitted shall be acquired from the display image queue corresponding to the login user of the display image request source (example: client terminal 100G1 in FIG. 5). Further, the image transmitted to the client terminal 100G1 is deleted from the display image queue.

The CPU 201 of the client terminal 100G1 receives the display image transmitted in step S516 (step S517), and as shown in FIG. 920, the received display image (here, the image of the active window 902 on the desktop of the client terminal 100H). ) Is displayed in full screen. Similarly, another client terminal 100 (for example, 100G2) also makes a request for acquiring a display image, receives the display image, and displays the display image in full screen (step S518).

After step S519, the CPU 201 of the client terminal 100H determines in step S520 whether or not the operation for ending the display image sharing process started in step S504 has been accepted (step S520). For example, when the pressing of the "x" button 901 ("close" button) in 900 in FIG. 9 is accepted, it is determined that the operation to end the sharing of the display image is accepted, and the end of the sharing of the display image is terminated by the web conference server 200. Is notified, and the process of FIG. 5 is terminated. Further, when the operation of ending the sharing of the display image is accepted, the value of the permission information 740 in the memory is cleared (deleted). The CPU 201 of the web conferencing server 200 receives the end notification, notifies the end notification to the other client terminal 100, and the CPU 201 of the other client terminal 100 that receives the notification ends the full-screen display of the display image. Then, the conference screen as shown in FIG. 9 is displayed on the display screen. If the operation for ending the sharing of the display image is not accepted, the process proceeds to step S507, and the sharing of the display image is continued. The above is the description of FIG.

Next, with reference to FIG. 7, the flow of the process of changing the shared display image in the first embodiment of the present invention will be described.

The CPU 201 of the client terminal 100H starts monitoring the activation of the application window that is not stored in the permission information 740. Specifically, it monitors the expansion / maximization of the minimized window issued by the OS, the startup of unstarted applications (new applications), and the issuance of mouse click and key input operation events for the currently displayed window. To detect. The CPU 201 of the client terminal 100H detects an event of a user operation on the own machine.

The CPU 201 of the client terminal 100H determines whether or not an operation for a window different from the current active window (example: window 902 in 900) has been accepted (step S602). That is, it is determined whether the event detected in step S601 indicates an operation of activating a window other than the currently active window. Specifically, the OS issues an event for mouse click or key input operation to a window other than the currently active window, and when the event is detected, the window other than the currently active window is activated and the most is activated. It is determined that the operation to be displayed on the front surface has been accepted, and the process proceeds to step S605. Further, for example, the window ID of the application window that receives the operation to be displayed in the foreground, which is specified from the character string of the event, is stored in the memory. If the detected event is not an operation event for another window being displayed, the process proceeds to step S603.

The CPU 201 of the client terminal 100H determines whether the event detected in step S601 is an event of canceling the minimization of the minimized window (example: window 906 in 900) (expanding the window on the desktop screen) (step S603). That is, it is determined whether or not the operation of activating the minimization window 906 and displaying it in the foreground is accepted. If it is determined that the minimization release event has been detected, the process proceeds to step S605. Further, for example, the window ID of the application window that has received the operation of releasing the minimization, which is specified from the character string of the event, is stored in the memory. If the detected event is not a minimization release event, the process proceeds to step S604.

The CPU 201 of the client terminal 100H determines whether the event detected in step S601 is an event of a start operation of an unstarted application (example: a start operation of application 003 in 1100 of FIG. 11) (step S604). For example, as shown in FIG. 11, it is determined whether the pressing of the icon 1101 of the unstarted application is accepted (whether the window of the application started by the pressing operation is activated and the instruction to be displayed in the foreground is accepted). If it is an event of a start operation of an unstarted application, the process proceeds to step S605. Further, for example, the window ID of the application window that has received the start operation, which is specified from the character string of the event, is stored in the memory. If it is not an event of the start operation of the unstarted application, the process of FIG. 6 is terminated.

In step S605, the CPU 201 of the client terminal 100H stops the process of transmitting the display image to the web conference server 200 (step S605 / stops the process of acquiring / transmitting the latest image from the display image queue 730). Then, in step S606, the window ID of the application window (active window) displayed in the foreground on the desktop is inquired to the OS to be specified / acquired, and the active window 750 is overwritten and stored (step S606).

That is, by the processing of step S605, the display image (the image of the active window, that is, the image of the application window operated in step S602, or the application window after the minimization that received the operation of the minimization release in step S603). The transmission of the image or the image of the application window after the application newly started in step S604 is started is suspended to the web conference server 200.

When the transmission of the display image to the web conference server 200 is stopped, each guest terminal (example: client terminal 100G1) cannot receive / acquire the display image from the web conference server 200. Therefore, instead of the display image, FIG. A black-painted screen as shown in 930 is displayed.

Further, the CPU 201 of the web conference server 200 cannot receive the display image from the host terminal (eg, the client terminal 100H) for a predetermined time (for example, 3 seconds), and cannot continuously store the image for 3 seconds in the display image queue. If it is determined that the image is not correct, as shown in 930 of FIG. 9, a message screen including the message of 931 is generated and stored as the latest image in the display image queue for each guest terminal. The guest terminal acquires an image of the message screen from the display image queue for its own device on the web conference server 200 and displays it on the display screen. The CPU 201 of the web conferencing server 200 retains the image of the message screen as the latest image in the display image queue without deleting it until a new display image is received from the host terminal, even if the image of the message screen is transmitted to the guest terminal. .. Therefore, the message screen shown in 930 is displayed on the guest terminal until the transmission of the display image from the host terminal is reunited.

The CPU 201 of the client terminal 100H acquires the window ID of the application window whose image transmission is stopped in step S605 from the active window 750 on the memory, collates it with the permission information 740, and displays the application window indicated by the window ID. It is determined whether or not sharing the image to another terminal is an unauthorized window (step S607).

If the window is not permitted, the CPU 201 of the client terminal 100H shifts the process to step S608 and displays a permission confirmation screen as shown in 912 in 910 of FIG. 9 (step S608 / confirmation screen display). ). 911 in FIG. 9 shows window 906 of activated application 003.

By displaying the permission confirmation screen, it is possible to notify the user that the application window for which sharing is not permitted becomes active.

In addition, the user can be notified that the sharing of the image of the application window is suspended.

On the permission confirmation screen 912, the CPU 201 of the client terminal 100H determines whether the operation of permitting the sharing of the image of the application window in which the transmission of the image is stopped is performed or the operation of disallowing the sharing is performed in step S605. (Step S609). Specifically, when the press of the "Yes" button in 912 is accepted, it is determined that the selection operation to allow sharing of the application has been performed, and when the press of the "No" button is accepted, the application concerned. It is determined that the selection operation to the effect that the sharing is not permitted and is not permitted is performed.

When it is determined that the operation to allow sharing is accepted, the other client terminal 100 of the application window (of the ID stored in the active window 750) activated by the operation of step S601, S602, or S603. In order to allow sharing to, the sharing permission 742 of the window ID 741 of the permission information 740 is rewritten to "permission" and stored / updated (step S610). Then, sharing of the image of the active window (transmission of the display image to the web conferencing server 200 / transmission of the display image to the other client terminal 100 via the web conferencing server 200) is resumed (step S611). That is, the transmission stop of the display image is released.

When the "No" button is accepted on the permission confirmation screen 912, the permission information 740 sharing permission 742 of the application window activated by the operation of step S601, S602, or S603 is "not permitted". Is rewritten and stored / updated (step S612). Then, the permission confirmation screen is closed. That is, since sharing of the activated application window is not permitted, the transmission of the image of the active win-win to the web conferencing server 200 is stopped until the application window to which sharing is permitted becomes active. If left unchecked, the guest terminal will continue to display the message screen shown in 930 until the application window that is allowed to be shared is activated.

On the other hand, in step S607, if a value other than "not permitted" is already stored in the sharing permission 742 ("permitted" or "not permitted" is inserted), the process proceeds to step S613.

In step S613, the CPU 201 of the client terminal 100H has "permitted" registered or "not permitted" registered in the sharing permission 742 of the application window (window ID 741) of the image whose sharing has been stopped in step S605. Is determined (step S613). That is, it is determined whether or not sharing of the image is permitted.

If "permission" is registered, the process proceeds to step S611. If "not permitted" is registered, the process of FIG. 6 ends. That is, while the application window is active, the transmission of the displayed image to the web conferencing server is stopped. The above is the description of FIG.

In the description of the above-described embodiment, the transmission of the display image is stopped once in step S605, and when it is determined in step S613 that sharing is permitted, the transmission of the display image is restarted. However, this causes the transmission of images in the window to be suspended even if the application window that is allowed to be shared is activated.

In order to prevent interruption of transmission of the display image, for example, immediately before step S605, the active window is inquired and specified to the OS, stored in the active window 750, and the window of the active window 750 (that is, step S602, or It is determined whether or not sharing of the image of (application window activated by the operation of S603 or S604) to another terminal is permitted in the permission information 740, and sharing is not permitted (sharing permission 742 = "not yet". In the case of "permitted" or "not permitted"), the process may be shifted to step S605. If sharing is permitted, the process of FIG. 6 ends. After stopping the sharing of the display image in step S605, instead of step S606, whether the sharing of the image of the application window whose transmission was stopped in step S605 is set to "not permitted" or "not permitted" is set. , The determination is made with reference to the permission information 740, the process proceeds to step S607 when "not permitted" is set, and the process of FIG. 6 is terminated when "not permitted" is set. To do. By determining, for example, the sharing permission state of the application window activated by the user operation before step S605, it is possible to prevent suspension / interruption of transmission of the image of the window for which sharing is permitted. In addition, it is possible to confirm with the user who is permitted / not permitted to share the display image for which sharing is not permitted, and to stop sharing the image for which sharing is not permitted.

Further, the window registered as permitted to share in step S611 and the window registered as not permitted to share in step S612 may be displayed in an identifiable manner. Specifically, in step S611, the display position on the desktop screen of the window permitted to be shared is obtained by inquiring to the OS, and “sharing permission” as shown by the icon 1001 in 1000 in FIG. 10 is shown on the window. Display the icon. When the window to which sharing is permitted is active, the screen shown in 1020 of FIG. 10 is displayed on the screen of the guest terminal. Further, in step S612, the display position on the desktop screen of the window for which sharing is permitted is inquired to the OS to obtain the window, and "sharing prohibited" as shown by the icon 1011 in 1010 of FIG. 10 is shown on the window. Display the icon. The identification display by the icon allows the user to confirm the windows that are permitted to be shared and the windows that are not permitted to be shared on the desktop screen. When the window for which sharing is prohibited is active, a screen like 1031 shown in 1030 of FIG. 10 is displayed on the screen of the guest terminal. The screen of 1031 is distributed to the guest terminal by the CPU 201 of the host terminal generating the image of the screen of the 1031 and keeping it as the latest image in the display image queue 730 of the next unit in step S612. Is displayed on the screen of.

As described above, according to the first embodiment of the present invention, it is possible to facilitate selection of a display image to be shared by a plurality of terminals and to provide a mechanism for sharing a necessary image with each terminal.

Further, at the timing of selecting / specifying the display image from the second time onward, the display image once permitted to be shared can be shared to each terminal without confirmation of whether or not sharing is permitted.

In addition, at the timing of selecting / specifying the display image from the second time onward, it is necessary to control so that the image of the application whose sharing is once prohibited is not shared by omitting the confirmation of whether or not the sharing is permitted. Can be done.

Also, after a while after the window is minimized, it may be forgotten what kind of content is contained in the minimized window. Also, if the operator of the host terminal is replaced by another person, it is not possible to know what kind of content is contained in the minimized window. In other words, even if the application window is allowed to be shared once, it may be better to suspend the sharing of the image each time it is activated and ask the user whether the image of the window should be shared. Therefore, for example, the value of the sharing permission 742 of the permission information 740 is updated to "unauthorized" and stored every time the application window of the window ID shown in 741 becomes inactive (moves to the back of another window). You may do it. As a result, each time an operation for activating an inactive window is accepted, image sharing can be paused and the user can be asked if the image of the window should really be shared.

Further, in the host terminal, even if the window is inactive, the entire application window may be confirmed as shown in 903 of FIG. Even though the user knows and selects what information the window contains, each time it is activated, it suspends image sharing and asks for permission / non-permission of sharing. This will unnecessarily increase the user's effort. Therefore, for example, the value of the sharing permission 742 of the permission information 740 may be updated and stored as "not permitted" each time the application window of the window ID shown in 741 detects an event that is minimized. As a result, when accepting the operation of redisplaying the minimized window and activating it again, the image sharing can be suspended and the user can confirm whether or not the image of the window should be shared.

<Second embodiment>

Next, a second embodiment of the present invention will be described with reference to FIG. The description of the processing common to the first embodiment will be omitted. FIG. 12 is a diagram showing an example of various data structures in the second embodiment of the present invention.

In the second embodiment of the present invention, when a predetermined user is participating in a conference, it is easy to select a display image to be shared by a plurality of terminals, and a mechanism for sharing a necessary image with each terminal is provided. The purpose is.

In the second embodiment, the user information 1200 registered / stored in association with the user information 700 by the authority ID 1201 is stored in the external memory of the web conferencing server 200. Here, it is assumed that three authorities are prepared as shown in 1202. As shown in the authority correspondence information 1320 of FIG. 12, these authority IDs and applications are stored in advance in the external memory of the client terminal 100H (stored in the external memory of the web conference server 200, and the web conference server 200. The client terminal 100 acquires and stores the information when logging in to the server). 1251 is an application ID, and 1252 is an authority ID of a user whose sharing of the application shown in the application ID 1251 is recommended (permitted).

In step S502 of FIG. 5, the CPU 201 of the client terminal 100H transmits the running application list (application ID list) to the web conferencing server 200. Also, in the application list, the application that is permitted to be shared by the user (user ID) who is logged in to the same conference as the logged-in user who is logged in to the web conference server 200 from the client terminal 100H, and the application that is permitted to be shared. Inquire the web conference server 200 for the ID of the application that has not been logged in.

The CPU 201 of the web conference server 200 uses the ID of the application included in the received application list and the authority ID of the user (including the user of the client terminal 100H) who is participating in the same conference as the login user of the client terminal 100H. Then, according to the inquiry, the ID of the application for which sharing is permitted and the ID of the application for which sharing is not permitted are specified, and a list in which the ID of each application is associated with the possibility of sharing is transmitted to the client terminal 100H.

For example, the authority ID of User002 participating in the conference is 2, the authority ID of User003 is 3, and according to FIG. 12, sharing of the image display of the application 003 is recommended (permitted) to User002 and User003. Not. Sharing the image display of application 003 is recommended only for User001 with authority ID = 1. Therefore, application 001 and application 002 are applications that are permitted to be shared in the conference in which the user of the client terminal 100H participates, and application 003 is an application that is not permitted to be shared in the conference in which the user of the client terminal 100H participates. Information indicating that effect is transmitted to the client terminal 100H.

The CPU 201 of the client terminal 100H receives the list and enables selection of applications that are permitted to be shared, grayed out the applications that are permitted to be shared so that they cannot be selected, and makes it possible to identify both applications. Selection screen 811 Display in. Step S503 accepts the selection of the application to be permitted to share, and step S504 determines the application to be permitted to share. In step S505, a list of applications that are permitted to be shared is stored in the memory (for example, the permission information 1240 in FIG. 12 is stored / sharing permission 1242 corresponding to the application ID 1241 determined to be permitted to be shared is "permitted". Is stored in the sharing permission 1242 corresponding to the application ID 1241 grayed out as an application for which sharing is not permitted, and the sharing permission 1242 corresponding to the application ID 1241 not selected as the permitted application is stored. Remembers "unauthorized"). In step S507, among the windows of the application permitted to be shared, the active window is specified, stored in the display image queue, and transmitted to the web conference server. After that, the processes of steps S509 to S518 are executed.

Further, in step S607 of FIG. 6, it is determined whether or not the application of the active window is an application for which sharing is not permitted by referring to the permission information 1240. If it is not permitted, the process proceeds to step S608. If it is permitted or not permitted, the process proceeds to step S613. In step S613, the application in the active window determines whether sharing is permitted or disallowed. If it is not permitted, the process of FIG. 6 is terminated, and if it is permitted, the process proceeds to step S611. After executing the process of step S608, if it is determined in step S609 that the operation for permitting sharing has been performed, the process proceeds to step S610. If it is determined that an operation for disallowing sharing has been performed, the process proceeds to step S612. In step S610, the sharing permission 1242 (in the permission information 1240) corresponding to the ID of the application in the active window is updated to “permission” and stored, and the process proceeds to step S611. In step S611, the sharing permission 1242 corresponding to the ID of the application in the active window is updated to “not permitted” and stored, and the process of FIG. 6 ends.

As described above, according to the second embodiment, when a user with a predetermined authority is participating in a conference, an unauthorized image is unintentionally shared on the shared image. Can be prevented.

<Third embodiment>

In the third embodiment, a mechanism for preventing unintentional sharing of an unauthorized display image is provided according to the type (type) of the terminal of the user participating in the conference. The description of each common process described above is omitted.

The web conferencing server 200 inserts and stores the information of the terminal type and the communication method requested to enter the room, which are included in the request received in step S407, into the terminal type 1215 and the communication method 1216, respectively. Further, as shown in 1260 of FIG. 12, the application ID 1261 and the terminal type 1262 for which sharing of the image display of the application indicated by the 1261 is recommended (permitted) are stored in advance in the external memory of the client terminal 100H. (It is stored in the external memory of the web conference server 200, and the client terminal 100 acquires and stores the information when logging in to the web conference server 200).

In step S502 of FIG. 5, the CPU 201 of the client terminal 100H refers to the list of running applications (list of application IDs), 1215 of the conference information 1210 in the own machine, and 1260 of the terminal type correspondence information from the client terminal 100H. The ID of the application that is permitted to be shared by the user (user ID) who is logged in to the same conference as the logged-in user who is logged in to the web conference server 200 and the ID of the application that is not permitted to be shared are specified. Specifically, it is determined whether the terminal of the user who is participating in the same conference as the client terminal 100H includes the client terminal 100 of the terminal type for which sharing of the image display of the application 003 is not recommended. For example, the client terminal 100G1 has a terminal type = mobile, and the client terminal 100G2 has a terminal type = pc. According to 1260 of FIG. 12, sharing of the image display of the application 003 is not recommended for the client terminal 100G1. Sharing the image display of application 003 is recommended for the client terminal 100G2 with terminal type = pc. Therefore, application 003 is identified as an application that is not allowed to be shared at the conference. According to the information of 1210 and 1260 of FIG. 12, application 001 and application 002 are specified as applications that are permitted to be shared at the conference.

The CPU 201 of the client terminal 100H can select the application for which sharing is permitted, grays out the application for which sharing is permitted to be unselectable, and displays both applications on the selection screen 811 so as to be distinguishable. Hereinafter, since the processes of steps S503 to S518 are the same as the processes described in the second embodiment, the description thereof will be omitted. In step S505, a list of applications determined to be permitted to be shared in step S504 is stored in the memory as permission information 1240 (in the sharing permission 1242 corresponding to 1241 of the application ID determined to be permitted to be shared). Stores "permitted" and stores "not permitted" in sharing permission 1242 corresponding to application ID 1241 grayed out as an application for which sharing is not permitted, and shares corresponding to application ID 1241 not selected as an permitted application. "Not permitted" is stored in the permission 1242).

In FIG. 6, the permission information 1240 stored in step S505 of the third embodiment (information for which sharing is not permitted depending on the terminal type is stored, and sharing is permitted or not permitted by the user's selection operation. The processing of step S607 and step S613 is executed by the method described above in the description of the second embodiment based on the information). The above is the description of the third embodiment.

According to the third embodiment, it is possible to prevent an unauthorized image from being unintentionally shared on the shared image according to the terminal type of the terminal of the user participating in the conference. it can.

<Fourth Embodiment>

In the fourth embodiment, a mechanism for preventing unintentional sharing of unauthorized images is provided according to the communication method of the terminals of the users participating in the conference. The description of each common process described above is omitted.

As shown in 1270 of FIG. 12, the communication method 1272 of the terminal for which sharing of the image display of the application indicated by the application ID 1271 is recommended (permitted) is stored in advance in the external memory of the client terminal 100H. (It is stored in the external memory of the web conference server 200, and the client terminal 100 acquires and stores the information when logging in to the web conference server 200).

In step S502 of FIG. 5, the CPU 201 of the client terminal 100H refers to the list of running applications (list of application IDs), 1215 of the conference information 1210 in the own machine, and 1270 of the communication method correspondence information from the client terminal 100H. The ID of the application that is permitted to be shared by the user (user ID) who is logged in to the same conference as the logged-in user who is logged in to the web conference server 200 and the ID of the application that is not permitted to be shared are specified. Specifically, it is determined whether or not the terminal of the user participating in the same conference as the client terminal 100H includes the client terminal 100 that communicates using a communication method for which sharing of the image display of the application 003 is not recommended. For example, the communication method of the client terminal 100G1 is wireless, and the communication method of the client terminal 100G2 is wireless-line. According to 1270 of FIG. 12, sharing of the image display of application 003 is not recommended for the client terminal 100G1. Sharing the image display of application 003 is recommended for the client terminal 100G2 of the communication method 1272 = were-line. Therefore, application 003 is identified as an application that is not allowed to be shared at the conference. According to the information of 1210 and 1270 of FIG. 12, application 001 and application 002 are specified as applications that are permitted to be shared at the conference.

The CPU 201 of the client terminal 100H can select the application for which sharing is permitted, grays out the application for which sharing is permitted to be unselectable, and displays both applications on the selection screen 811 so as to be distinguishable. Hereinafter, since the processes of steps S503 to S518 are the same as the processes described in the second embodiment, the description thereof will be omitted. In step S505, a list of applications determined to be permitted to be shared in step S504 is stored in the memory as permission information 1240 (in the sharing permission 1242 corresponding to 1241 of the application ID determined to be permitted to be shared). Stores "permitted" and stores "not permitted" in sharing permission 1242 corresponding to application ID 1241 grayed out as an application for which sharing is not permitted, and shares corresponding to application ID 1241 not selected as an permitted application. "Not permitted" is stored in the permission 1242).

In FIG. 6, the permission information 1240 stored in step S505 of the third embodiment (information for which sharing is not permitted depending on the communication method is stored, and sharing is permitted or not permitted by the user's selection operation. The processing of step S607 and step S613 is executed by the method described above in the description of the second embodiment based on the information). The above is the description of the fourth embodiment.

According to the fourth embodiment, it is possible to prevent unintentional sharing of an undisplayed image on the shared image according to the communication method of the terminal of the user participating in the conference. it can.

<Fifth Embodiment>

In the fifth embodiment, a mechanism for preventing unintentional sharing of an unauthorized image according to a character string included in the image of the application window is provided. The description of each common process described above is omitted.

As shown in 1220 of FIG. 12, the character string 1221 and the sharing permission 1222 indicating whether or not sharing of the image including the character string is permitted are stored in advance in the external memory of the client terminal 100H (web conference). It is stored in the external memory of the server 200, and the client terminal 100 acquires and stores the information when logging in to the web conference server 200). In addition, the image and text information of the file opened by the running application (started application) is transmitted to the web conference server 200, and which character string 1231 is included in the file opened by which application 1232 by the web conference server 200. The application character string information 1230 that manages whether or not it is included is generated and stored in the memory. The client terminal 100 requests the web conferencing server 200 to acquire the application character string information 1230, and stores it in the memory.

In step S502 of FIG. 5, the CPU 201 of the client terminal 100H refers to the list of running application windows, the character string permission information 1220, and the application character string information 1230, and the window to which sharing is permitted and the sharing are performed. Identify the ID of a window that is not allowed. Specifically, the ID of the window including the character string 1221 for which sharing permission 1222 is not permitted in the character string permission information 1220 is specified by referring to the application character string information 1230, and the application for which sharing is not permitted is specified. Determine and specify as a window. Further, the ID of the window that does not include the character string 1221 for which sharing permission 1222 is not permitted in the character string permission information 1220 is specified with reference to the application character string information 1230, and the application window for which sharing is permitted. Determine and specify as.

The CPU 201 of the client terminal 100H can select the application for which sharing is permitted, grays out the application for which sharing is permitted to be unselectable, and displays both applications on the selection screen 811 so as to be distinguishable. Hereinafter, since the processes of steps S503 to S518 are the same as the processes described in the first embodiment, the description thereof will be omitted. In step S505, a list of applications determined to be permitted to be shared in step S504 is stored in the memory as permission information 1240 (in the sharing permission 1242 corresponding to 1241 of the application ID determined to be permitted to be shared). Stores "permitted" and stores "not permitted" in sharing permission 1242 corresponding to application ID 1241 grayed out as an application for which sharing is not permitted, and shares corresponding to application ID 1241 not selected as an permitted application. "Not permitted" is stored in the permission 1242).

In FIG. 6, immediately before step S606, the character string 1231 of the file opened in the active window (example: the window of application 003 in FIG. 9) and the character string permission information 1220 are referred to, and the file is opened in the active window. It is determined whether or not the application has opened a file containing the character string of sharing permission 1322 = "not permitted". When a file containing the character string "Share permission 1322 =" Not permitted "is open, the process of FIG. 6 ends. Sharing permission 1322 = When a file containing the character string "not permitted" is not opened, the permission information 1240 is referred to to determine whether the active window is a window for which sharing is not permitted or a window for which sharing is permitted. If sharing is permitted, the process proceeds to step S611, and if sharing is not permitted, the process proceeds to step S608.

According to the fifth embodiment, it is possible to prevent the unauthorized image from being unintentionally shared according to the character string included in the image of the application to be displayed on the image being shared.

For example, it is possible to prevent unintentional sharing of an image containing a confidential character string.

As described above, according to the present invention, it is possible to easily select a display image to be shared by a plurality of terminals and provide a mechanism for sharing a necessary image with each terminal.

It is assumed that the inventions of the above-described embodiments can be freely combined and executed.

Further, in the description of the above-described embodiment, when the CPU 201 of the client terminal 100 accepts the change operation of the active window, the image (display image) of the newly activated application window is transmitted to the server 200. By pausing, sharing of unnecessary images is prevented. For example, each client of the displayed image is sent to the server 200 without stopping the transmission of the displayed image from the own machine to the server 200. By instructing to stop the distribution to the terminal 100 and stopping the distribution, sharing of unnecessary images may be prevented. Specifically, the server 200 is instructed not to store the display image in the display image queue, and the CPU 201 of the server 200 that receives the instruction displays the display image received from the client terminal 100H, which is the host. By discarding the displayed image without storing it in the image queue, the distribution of the displayed image is stopped.

Further, the present invention can be implemented as, for example, a system, an apparatus, a method, a program, a storage medium, or the like, and specifically, may be applied to a system composed of a plurality of devices. It may be applied to a device consisting of one device.

Specifically, the web conferencing server 200 may execute the processes of steps S601 to S613 of FIG. 6, which were executed by the host terminal (client terminal 100H). In this case, the event monitoring issued by the OS of the host terminal and various inquiries to the OS shall be detected and executed by the CPU 201 of the web conferencing server 200 communicating with the host terminal via the network 150. .. Further, the various data of FIGS. 7 and 12 stored in the client terminal 100 are transmitted to the web conferencing server 200 each time the client terminal 100 acquires the data, and the web conferencing server 200 that receives the data receives the data in its own memory. Various data shall be stored.

The present invention includes a software program that realizes the functions of the above-described embodiments, which is directly or remotely supplied to the system or device. The present invention also includes cases where the computer of the system or device can also read and execute the supplied program code.

Therefore, in order to realize the functional processing of the present invention on a computer, the program code itself installed on the computer also realizes the present invention. That is, the present invention also includes a computer program itself for realizing the functional processing of the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, MOs, CD-ROMs, CD-Rs, CD-RWs, and the like. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROM, DVD-R) and the like.

In addition, as a program supply method, a browser of a client computer is used to connect to an Internet homepage. Then, the computer program itself of the present invention or a compressed file including the automatic installation function can be supplied from the homepage by downloading it to a recording medium such as a hard disk.

It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different homepages. That is, the present invention also includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer.

In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and the key information for decrypting the encryption is downloaded from the homepage to the user who clears the predetermined conditions. Let me. Then, by using the downloaded key information, it is also possible to execute an encrypted program and install it on a computer.

Further, the function of the above-described embodiment is realized by the computer executing the read program. In addition, based on the instruction of the program, the OS or the like running on the computer performs a part or all of the actual processing, and the function of the above-described embodiment can be realized by the processing.

Further, the program read from the recording medium is written to the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer. After that, based on the instruction of the program, the function expansion board, the CPU provided in the function expansion unit, or the like performs a part or all of the actual processing, and the function of the above-described embodiment is also realized by the processing.

It should be noted that the above-described embodiments merely show examples of embodiment in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner by these.
That is, the present invention can be implemented in various forms without departing from the technical idea or its main features.

100 Client terminal 100G1 Client terminal 100G2 Client terminal 101 Camera 102 Microphone 103 Speaker 150 Network 200 Web conference server

Claims (7)

An information processing device provided with a sharing means for sharing a specified display image among a plurality of client terminals.
A specific means of identifying the active window and
A display image which is the image of the active window, determining means for determining as a display image to be shared by the sharing unit,
With
The sharing means is characterized in that a display image, which is an image of the active window determined by the determination means, is shared by the plurality of client terminals .
The information processing device further
When a new window is activated, the sharing stop means for stopping the sharing of the display image shared by the sharing means, and the sharing stop means.
An information processing device characterized by being equipped with . A confirmation screen display means for displaying a confirmation screen for confirming whether or not sharing of the newly activated window image is permitted by the sharing means, and
With
The information processing apparatus according to claim 1 , wherein the sharing means shares an image of a window in which sharing by the sharing means is permitted on the confirmation screen as a new display image. .. In the confirmation screen, the newly window becomes active image, if the operation to allow sharing by said shared unit is, by the sharing unit, an image of the newly active window, The information processing apparatus according to claim 2 , wherein the sharing of the new display image is started . According to the operation received on the confirmation screen, the permission information storage means for storing the permission information including whether the sharing by the sharing means is permitted or not is permitted for each window.
With
The confirmation screen display means, the permission information storage unit, the information of the newly unauthorized indicating permission and prohibition of sharing by the shared device window image becomes active is pending is stored The information processing apparatus according to claim 2 or 3 , wherein the confirmation screen is displayed when the information processing device is used. A control method for an information processing device provided with a sharing means for sharing a specified display image among a plurality of client terminals.
A specific process to identify the active window and
A display image which is the image of the active window, the determining step of determining as a display image to be shared by the sharing unit,
Including
The sharing means is characterized in that a display image, which is an image of the active window determined by the determination step, is shared by the plurality of client terminals .
The control method of the information processing device is further described.
When a new window is activated, a sharing stop step of stopping sharing of the display image shared by the sharing means, and a sharing stop step.
A control method for an information processing device, which comprises . A program that can be executed by an information processing device that has a sharing means for sharing a specified display image among multiple client terminals.
The information processing device
A specific means of identifying the active window and
The display image, which is an image of the active window, is made to function as a determination means for determining the display image to be shared by the sharing means.
The sharing means is characterized in that a display image, which is an image of the active window determined by the determination means, is shared by the plurality of client terminals .
Further, the information processing device
A program for functioning as a sharing stop means for stopping sharing of the display image shared by the sharing means when a new window is activated . An information processing system including an information processing device provided with a sharing means for sharing a specified display image among a plurality of client terminals and a conference server.
A specific means of identifying the active window and
A display image which is the image of the active window, determining means for determining as a display image to be shared by the sharing unit,
With
The sharing means is characterized in that a display image, which is an image of the active window determined by the determination means, is shared by the plurality of client terminals .
The information processing system further
When a new window is activated, the sharing stop means for stopping the sharing of the display image shared by the sharing means, and the sharing stop means.
An information processing system characterized by being equipped with .

Images