JP2015222567A - Information processor, control method for information processor, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control an acquisition request of a content image displayed in accordance with display situations of the content to an area where a plurality of contents are displayed.SOLUTION: An information processor which can display a content distributed by a server via a network to a prescribed display area, has: content acquisition request starting means which makes an acquisition request for the content displayed to the display area of the server; display change receiving means which receives a change instruction of a display position of the content displayed to the display area; first content identifying means which identifies contents that have been displayed to the display area prior to starting of the change of positions; acquisition request stopping means which stops the acquisition request for the server of the contents that are not displayed when the content identified by the first content identifying means is not displayed to the display area after the display positions of the content is changed by the change instruction of the display position.

Description

  The present invention relates to an information processing apparatus, a control method for the information processing apparatus, and a program.

  In recent years, web conferencing systems in which a plurality of client terminals (usually personal computers) and servers are connected via a network and users exchange information in real time via the network using each client device have become widespread.

  According to the web conferencing system, users in remote locations can be collected in a virtual space (virtual conference room) on the network, and users in multiple remote locations can be displayed on one screen. It is possible to have a meeting. Further, Patent Document 1 that is an information processing apparatus that displays a plurality of images on one screen has been proposed.

JP2013-50940A

  In an apparatus as shown in Patent Document 1, a plurality of main screens and sub-screens are displayed on the display screen of the information processing apparatus, the sub-screen is hidden according to a user's slide operation, and the main screen is displayed as one screen. It is supposed to be displayed.

  In such a case, it is not necessary to update the image to be displayed on the non-displayed screen (it may be wasted), so it may be desirable to stop the image acquisition. In Patent Document 1, there is no mention as to whether an image is acquired even when a non-displayed sub-screen is not displayed. Further, in the case of Patent Document 1, since the position where the sub screen is displayed is a fixed frame, it can be easily recognized whether the sub screen is displayed.

  Furthermore, when the position of the frame where the sub-screen is displayed moves within the area, it is necessary to consider whether the frame is displayed within the display area.

  Therefore, an object of the present invention is to provide an information processing apparatus that can control an acquisition request for a content image to be displayed in accordance with a display state of the content in an area where a plurality of contents are displayed.

  An information processing apparatus capable of displaying content distributed from a server via a network in a predetermined display area, and content acquisition request start means for making an acquisition request for the content displayed in the display area to the server Display change accepting means for accepting an instruction to change the display position of the content displayed in the display area; and display in the display area before the change of the display position of the content by the instruction to change the display position is started. The content specified by the first content specifying means is displayed in the display area after the change of the display position of the content in response to the display position change instruction is completed. If not, the acquisition to stop the acquisition request to the server for the content that is not displayed It has a required stop means.

  According to the present invention, it is possible to control an acquisition request for a content image to be displayed according to a display state of the content in an area where a plurality of contents are displayed.

It is a figure which shows an example of the system block diagram of the web conference system concerning embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus concerning embodiment of this invention. It is a function block diagram of an example of a function structure of the information processing apparatus which comprises the web conference system concerning embodiment of this invention. It is a figure which shows an example of the screen transition of the information processing apparatus concerning embodiment of this invention. It is a figure which shows an example of the display screen of the conference room of the information processing apparatus concerning embodiment of this invention. It is a flowchart which shows an example of the whole process of the information processing apparatus concerning embodiment of this invention. It is a flowchart which shows an example of the <cell area existence determination processing> of the information processing apparatus concerning embodiment of this invention. It is a flowchart which shows an example of <the image acquisition control process of the cell currently displayed at the time of start> of the information processing apparatus concerning embodiment of this invention. It is a flowchart which shows an example of <the image acquisition control process of the cell displayed at the time of a stop> of the information processing apparatus concerning embodiment of this invention. It is a figure which shows an example of the cell information table of the information processing apparatus concerning embodiment of this invention. It is a sequence diagram which shows an example of the sequence concerning acquisition of the content data of the web conference system concerning embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an example of a system configuration diagram of a web conference system according to an embodiment of the present invention.

  In the web conference system of the present invention, for example, an information processing apparatus 100 (300, 310) to which a personal computer can be applied and a web conference server 100 that can use the web conference system at each client terminal are connected via a network 110. ing.

  The web conference server 200 is a server for realizing a web conference using a web browser. The information processing apparatus 100 can obtain a web conference screen (interface) and conduct a web conference by accessing the web conference server 200. In the present embodiment, a tablet PC will be described as an example, such as the information processing apparatuses 100 and 300, but a notebook PC such as the information processing apparatus 310, a desktop PC (not shown), or the like can also be used. The information processing apparatus can display an image of content distributed from the web conference server in a predetermined display area.

  A web browser for accessing the web conference server 100 and a dedicated module are installed in these information processing apparatuses 100. Note that this dedicated module is an ActiveX component that is downloaded from the web conference server 200 via a web browser, for example. Note that a web camera (not shown) is connected when transmitting a moving image of itself in a web conference, and a microphone (not shown) is connected when transmitting audio. Also, a speaker (not shown) is connected to view the other party's voice.

  The web conference system can perform screen sharing by displaying the screen of the information processing apparatus 100 on the screen of another information processing apparatus (300 or 310). The screen to be shared can be specified by the information processing apparatus 100, and may be a screen of an application to be specified or the entire desktop.

  The web conference system can set a plurality of virtual conference rooms on the web called a room, and can hold a plurality of conferences by setting a plurality of rooms.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus according to the embodiment of the present invention.

  As shown in FIG. 2, in the information processing apparatus 100, a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204, and an input controller 205 are connected via a system bus 200. , An audio input controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 are connected.

  The CPU 201 comprehensively controls each device and controller connected to the system bus 200.

  The ROM 202 or the storage device 204 is a control program executed by the CPU 201 such as a basic input / output system (BIOS) or an operating system (OS), a computer-readable program for realizing this information processing method, and various necessary programs. Holds data (including data table).

  The RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for executing the processing from the ROM 202 or the storage device 204 to the RAM 203 and executing the loaded program.

  The input controller 205 controls input from an input device such as a keyboard / touch panel 210. The input device is not limited to this, and may be a touch panel capable of detecting a position touched by a plurality of fingers, such as a mouse or a multi-touch screen.

  Various instructions can be performed when the user presses (touches with a finger or the like) in accordance with an icon, a cursor, or a button displayed on the touch panel.

  This input device is used to input a destination for a communication destination that can be used by various communication devices.

  The voice input controller 206 controls input from the microphone 211. Voice input from the microphone 211 can be recognized.

  The video controller 207 controls display on an external output device such as the display 212. The display includes a display of a notebook computer integrated with the main body. The external output device is not limited to a display, and may be a projector, for example. Further, for devices that can be received by the touch operation described above, it is also possible to receive input from the keyboard / touch panel 210.

  Note that the video controller 207 can control a video memory (VRAM) for display control, and a part of the RAM 203 can be used as a video memory area, or a dedicated video memory can be provided separately. Is possible.

  In the present invention, the first video memory area used for display when the user normally uses the information processing apparatus and the display overlaid on the display content of the first video memory area when a predetermined screen is displayed. A second video memory area used in The number of video memory areas is not limited to two, and a plurality of video memory areas can be provided as long as the resources of the information processing apparatus permit.

  The memory controller 208 controls access to the external memory 213. The external memory is connected via an adapter to an external storage device (hard disk), flexible disk (FD), or PCMCIA card slot that stores boot programs, various applications, font data, user files, editing files, and various data. A compact flash (registered trademark) memory or the like can be used.

  The communication I / F controller 209 is connected to and communicates with an external device via the network 214, and executes communication control processing in the network. For example, communication using TCP / IP, telephone lines such as ISDN, and communication using 3G lines of mobile phones are possible.

  The storage device 204 is a medium for permanently storing information, and the form is not limited to a storage device such as a hard disk. For example, a medium such as SSD (Solid State Drive) may be used.

  It can also be used as a temporary memory area during various processes performed by the communication terminal in the present embodiment.

  FIG. 3 is a functional configuration diagram illustrating an example of a functional configuration of the information processing apparatus configuring the web conference system according to the embodiment of the present invention.

  A functional configuration of the information processing apparatus configuring the web conference system illustrated in FIG. 1 will be described. The web conference system includes an information processing apparatus 100 (client terminal), a web conference server 200, and an information processing apparatus 300 (the information processing apparatus 310 is also a client terminal).

  For the sake of convenience, the information processing apparatus 100 and the information processing apparatuses 300 and 310 are separately described for the information processing apparatus, but any information processing apparatus may have the functions described here. It is also possible to configure the device to have all functions.

  The information processing apparatus 100 is connected to the web conference server 200 as a client terminal, and transmits and receives images. The OS includes a scroll start event transmission unit 311 and a scroll end event transmission unit 312.

  The scroll start event transmission unit 311 transmits to the conference application that the user has started scrolling. The transmission means that a conference start event is notified to the conference application. The OS may notify the conference application, or the conference application may monitor the OS and receive the event.

The scroll end event transmission unit 312 transmits to the conference application that the user has finished scrolling. The flow of notifying the event is the same as that of the scroll start event transmitting unit.
In this embodiment, it is described that the display change instruction is performed by scrolling. However, the display change instruction is not limited to scrolling, and a cell to be displayed is changed by a “next” or “arrow” button. In addition, a device that receives an instruction to change the display of a cell by tilting the terminal is also included.
In addition, this includes a case where a display change instruction is received from the remote by a remote operation or the like.

The conference application has an area in which main content is displayed and an area in which sub-contents are displayed, which will be described later with reference to FIG. 5. Content related to the web conference is displayed in cells in the display area. The scroll start event and the scroll end event refer to a scroll event to an area (or cell) where the sub-content is displayed.
Generally, the main content is displayed as a main screen by the user of the web conference, and an image to be noticed is often selected. The sub-content is a sub-image for the main screen, and in the web conference system, an image of the connected virtual conference room that is not the main image can be displayed as a plurality of sub-contents.

  The conference application includes a scroll start event receiving unit 313, a scroll end event receiving unit 314, a display cell acquisition unit 315, a region presence / absence determination unit 316, an image acquisition request control unit 317, an image reception unit 318, and a display control unit 319. .

  The scroll start event reception unit 313 receives a scroll start event from the OS scroll start event transmission unit 311. When an event is received, the screen displayed on the display control unit 319 is scrolled. The scroll control may be performed by the conference application or the OS.

  The scroll end event reception unit 314 receives a scroll end event from the OS scroll end event transmission unit 312. When an event is received, scrolling of the scrolled area of the screen displayed on the display control unit 319 stops.

  The display cell acquisition unit 315 acquires which cell is displayed in the area where the sub content is displayed. The area presence / absence determination unit 316 determines whether the cell acquired by the display cell acquisition unit 315 is completely displayed, that is, whether the display is completely displayed without being cut off from side to side (or up and down). Further, the complete display in the present invention includes a state in which the content can be viewed to an extent that the cell is not interrupted even if the cell is not completely displayed.

  In this embodiment, the image acquisition request control unit 317 functions as a content acquisition request control unit, and controls the web conference server to start and end acquisition requests for images corresponding to cells. Specifically, control is performed such that a cell that is not displayed in the sub-content display area does not acquire an image, and a cell that does not have display content requests acquisition of an image. In addition, for the cells that are displayed at both the start and end of scrolling, control relating to an image acquisition request is performed in particular, but image acquisition is continued.

  The image receiving unit 318 receives an image distributed by the web conference server, and the display control unit 319 controls display on the screen.

  The web conference server 200 includes an image acquisition unit 321, an image temporary storage unit 322, an image request acquisition unit 323, and an image distribution unit 324.

  The image acquisition unit 321 acquires the image received from the image transmission unit 321 of the information processing apparatus 300 (client terminal), and the image temporary storage unit stores it. When the image request acquisition unit 323 acquires an image acquisition request from the image acquisition request control unit 317 of the information processing apparatus 100, the image distribution unit 324 distributes the stored image to the image reception units 318 and 322 of the information processing apparatus.

  The conference management unit performs overall web conference management as a web conference server having a management function in the web conference system.

  FIG. 4 is a diagram showing an example of screen transition of the information processing apparatus according to the embodiment of the present invention.

  This screen shows the screen of the information processing apparatus 100, and shows screen transitions accompanying user operations.

  The login screen 401 is a screen for logging in to the web conference system, and is displayed by entering the address of the web conference server 200 in the access destination 402 and accessing it. (That is, in this embodiment, the IP address of the web conference server is “192.168.0.101”.)

  When the web conference server is accessed, a login menu 403 is displayed. Therefore, the logged-in user inputs a password for the user ID 404 (for example, his / her own) and password 405 and presses the login 406.

  When correct information is input and authentication is performed by the web conference server, the main menu 411 is displayed. In the menu 412, “conference participation” 413, “conference room reservation” 414, and “password change” 415 are displayed. When the access button 416 is pressed, the corresponding menu screen is displayed.

  When “join conference” 413 is pressed, a conference room list screen 421 is displayed. When “Reserve conference room” 414 is pressed, a conference room reservation screen (not shown) is displayed, and conference rooms reserved by the user on the screen are displayed on the conference room list screen 421. When “change password” 415 is selected, a password change screen (not shown) is displayed and the password can be changed.

  The conference room list screen 421 displays reserved conference rooms. By pressing the first meeting room 424, it is possible to enter the first meeting room which is a virtual meeting room on the web. 425 is an icon indicating whether or not the corresponding conference room is currently available. For example, an icon with a door open can be entered at the current time, and an icon with the door opened can be entered at the current time. It can be displayed in an identifiable manner that it is impossible (for example, it is not a reserved time).

  When the update 422 is pressed, the displayed conference room list can be updated, and when a keyword is input using the search 423, hit conference rooms are displayed.

  FIG. 5 is a diagram illustrating an example of a display screen of the conference room of the information processing apparatus according to the embodiment of the present invention.

The conference room screen 501 is a screen displayed on the display screen of the information processing apparatus 100, and an image is received from the web conference server. The meeting name 502 is “regular meeting (first meeting room)”. The screen is composed of main content 503 displayed with a large screen size and sub-contents 505 (A, C, B, and D in this screen) displayed with a small screen size. The sub content 505 is displayed as a cell in a display area 504 for displaying the sub content. The main content and sub-content are each sent from the participant A to the web conference server as an image of the camera taken by the participant G, and the web conference server distributes the image to the information processing apparatus displayed on this screen. It is what. By distributing a large number of images continuously, it can be viewed as a moving image by the user.
When participant G logs in from participant A, on this screen, images of participant A through participant D are displayed as sub-contents, participant G is displayed as the main content, and participants E and participants F Is hidden.

  Each sub-content display position is within an area represented by a coordinate position of (X, Y) = (0000,0000) to (X, Y) = (1000,0300), and each sub-content cell. In this embodiment, the size is 200 mm × 200 mm (the design can be arbitrarily changed). In the case of an information processing apparatus having a touch panel such as a tablet PC, the display position of the sub content is moved and displayed in the display area by scrolling the sub content by a touch operation with a user's finger or the like.

  Further, when the sub content is selected by double-clicking or the like, the image of the main content and the display position are switched. For example, when the sub content B505 is selected, B is displayed in the main content 503, and the image of the participant G moves to the cell where the image of the participant B has been displayed.

  FIG. 6 is a flowchart showing an example of the overall processing of the information processing apparatus according to the embodiment of the present invention.

  The process of starting scrolling on the sub-content display area of the conference room displayed in FIG. 5 is started. Here, it is assumed that the image acquisition request for the sub-content displayed when scrolling is started has already been made, and the image acquisition is continued until there is an instruction to stop the image acquisition request.

  In step S601, the OS detects that the user has started scrolling, and receives the information. For example, a scroll process operated by the user is received (display change receiving means). The web conference application acquires the cells displayed in the sub-con content display area in step S602 (first content specifying unit), and loops the number of the acquired cells in the process of step S603. The content specified by the first content specifying means is content that has been displayed before receiving the display change instruction, and has already been requested to acquire the content.

  In step S603, the cells displayed in the display area are identified as completely displayed cells that are not interrupted on one side. That is, it is determined whether or not the cell acquired in S602 exists in the display area. (Determining whether a cell exists)

  When the loop for the acquired cells is completed, in step S604, display control of the sub-content cells is performed in accordance with the received scroll instruction. This control process is a process that may be performed by the web conference application or the OS. (The same applies to step S606)

  Until a scroll stop event is received by the OS in step S605, display control (cell movement) is performed in step S604. If a scroll stop event is received, the process proceeds to step S606 and display control is accompanied by scroll stop. (Stop cell).

  The scroll stop event is an event when the user's scroll process automatically stops as time passes, or an event when the user intentionally stops the scroll process.

  In step S607, an image acquisition control process for the cell displayed at the start is performed, and in step S608, an image acquisition control process for the cell displayed at the stop is performed. Details will be described with reference to FIGS.

  FIG. 7 is a flowchart illustrating an example of <cell area existence determination processing> of the information processing apparatus according to the embodiment of the present invention.

  This corresponds to the cell region existence determination process in step S603 of FIG. In addition, when acquiring the cells displayed in the sub-content display area in step S602, when the screen 710 is taken as an example, five cells A to E are acquired. This is a web conference application that can be acquired from the OS.

  Further, in the process of step S703, since the completely displayed cells are specified, it is determined that the four cells A to D are completely displayed. (Cell E is determined to be interrupted.)

  The area presence / absence determination process will be described using a flowchart. In step S701, the coordinates and size of the display area of the sub content are specified. The coordinates and size are as described in FIG.

  In step S702, one target cell is acquired. The order may be the display order or the order of cells described in a cell information table described later. (In this embodiment, cell A is selected)

  In step S703, the coordinates and size of the cell are specified and registered in the cell information table (content information storage means) shown in FIG.

  FIG. 10 is a diagram showing an example of the cell information table of the information processing apparatus according to the embodiment of the present invention.

  The cell information table displays cell information 1000 (when scrolling is started) and cell information 1010 (when scrolling is stopped), but is updated to the latest information when scrolling is started (S601) and when it is stopped (S605). And is stored in the storage unit of the information processing apparatus 100. Further, in the case of a system that centrally manages information of client terminals, it can be configured to be stored in a web conference server.

  The cell ID 1001 is a cell ID, and is created in ascending order when the user logs in to the web conference system. The user ID 1002 is a logged-in user, and is displayed in the order of logging in. In the present embodiment, it can be seen that the user logs in to the web conference system in the order of user 0001 → 0003 → 0002 →.

  The cell coordinate 1003 is the coordinate position of the cell, and the one specified in step S703 is stored, and the final display image 1014 is not displayed even though there is a display image (out of the display area). ) The last image displayed in the cell is stored. As a result, an approximate image can be displayed without displaying the image on the web conference server when displaying a cell that is no longer displayed. In this embodiment, since cells A and B are no longer displayed by scrolling, “pics1X” and “pics2X” are stored as final display images, respectively.

  On the screen 1005, cells A to D are completely displayed, and cell E is incompletely displayed. In this case, the cell E of the cell coordinate 1003 is “0940, 0050”, and when 200 is added to the X coordinate, it becomes 1140 and exceeds the right end (1000 mm), so it is determined that it is not completely displayed.

  If the scroll stop command is received and the screen is displayed as 1015, it is determined that the cells B and F are incompletely displayed, and the cells C to E are completely displayed. At this time, the cell coordinate 1013 of the cell B is (−0025, 0050), and it can be seen that it does not fit on the left side. Similarly, since the cell F is (0935, 0050), it does not fit on the right side. I understand that.

  Further, in FIG. 5, it has been described that when the sub content is selected, the main content is replaced, but in that case (when the cell G is displayed in the display area of the sub content), a record of the cell G is stored in the cell information 1000 and 1010. Added. In this case, the record of the replaced cell (displayed in the main content) is deleted from the cell information.

  Returning to the description of FIG. 7, in step S704, it is determined whether or not the specified cell completely fits in the sub-content display area. If so, the process proceeds to step S705, where it is determined as an in-area cell and does not fit. In this case, the cell is identified as an out-of-region cell (partially closed cell) in step S706, and the process ends.

  FIG. 8 is a flowchart illustrating an example of <image acquisition control processing of a cell displayed at the start> of the information processing apparatus according to the embodiment of the present invention.

  A loop process is performed for each cell obtained in step S602 of FIG. 6 by the number of cells. In step S801, it is confirmed whether the cell displayed at the start of scrolling is also displayed at the stop (second content specifying means). (In the example of FIG. 10, cell A to cell E are to be looped. Cell A is not displayed when stopped, and cells B to E are displayed.)

  If it is determined in step S802 that it is not displayed, the process proceeds to step S805. On the other hand, if it is determined that it is displayed, the process proceeds to step S803, and the existence / non-existence determination process of the cell is performed. If it is determined in step S804 that the image is completely displayed (cells C to E), the process ends. That is, since an image has already been acquired, control relating to an image acquisition request is not performed.

  If the display is incomplete (cell B in FIG. 10) in step S804, the image request is a waste of resources, so in step S805 the image acquisition request to the web conference server is stopped (acquisition request stop unit), In S806, the final acquired image currently stored in the cell information table is stored in the cell information table (final acquired image storage means), and the process ends.

  FIG. 9 is a flowchart illustrating an example of <image acquisition control processing of a cell displayed when stopped> of the information processing apparatus according to the embodiment of the present invention.

  In step S901, the displayed cell, that is, the currently displayed cell in a stopped state is acquired (cell B to cell F in the example of FIG. 10), and processing is performed for each acquired cell. Loop.

  In step S902, it is determined whether or not the cell exists in the region, and in step S903, the process is terminated without performing any control on the cells determined not to be completely displayed (cell B and cell F in FIG. 10). On the other hand, in the case of a completely displayed cell (cells C to E in the example of FIG. 10), it is determined whether it is a cell (cell A to cell E in the example of FIG. 10) displayed at the start. If the cell is displayed at the time, the process proceeds to step S905 and the image acquisition is continued (in this case, agreeing to do nothing). On the other hand, if the cell is not displayed at the start, the cell is displayed. Since there is no image to be processed, the process proceeds to step S906, an image acquisition request corresponding to the cell is made to the web conference server (content acquisition request start means), and in step S907, the image received from the web conference server is acquired. The image acquired in step S908 is displayed in the target cell, and the process is terminated.

FIG. 11 is a sequence diagram showing an example of a sequence related to acquisition of moving image data in the web conference system according to the embodiment of the present invention.
A screen display thread 1101, a main thread 1102, a video transmission thread 1103, and a video reception thread 1105 are threads that the client terminal of the information processing apparatus 100 has, and are configured to be able to communicate with the web conference server 1104.

  Further, the processes of S1 to S9 are video transmission processes for transmitting the screen image of the information processing apparatus 100 to the web conference server as a moving image, and the processes of S10 to S19 are the contents of the screens of other information processing apparatuses. This is a video reception process for displaying as a moving image via the web conference server 1104.

In this embodiment, video transmission and video reception can be reproduced as a moving image by continuously transmitting and receiving images.
First, a video transmission process for transmitting the screen of the information processing apparatus 100 to the web conference server using S1 to S9 will be described.

This corresponds to the processing of the image transmission unit 321 in FIG. In the figure, the information processing apparatuses 300 and 310 have the information processing apparatus 100, but the information processing apparatus 100 can also have the information processing apparatus.
In S1, a video transmission start request is made. For example, when an opposite user enters the same conference room of the web conference system, the process is started when the user's own moving image is to be transmitted.

When receiving the video start request, the main thread 1102 requests the video transmission thread 1103 for a video transmission start request S2. When the request is accepted, the process from S4 to S8 is looped by loop (L2) until the video image transmission stop request S9 is received.
At the same time, the main thread 1102 receives the S3 screen preview data transmitted from the screen display thread, starts video image transmission S3.1, and stores the data in the video image queue in S3.1.1.

  The number of times the screen preview data transmission of S3 is called according to the video quality of the information processing apparatus 100 varies. For example, when the quality is high, the number of times increases, and when the quality is low, the number of times decreases. Further, while image preview data is being transmitted, loop L1 is performed.

  The video transmission thread 1103 performs video image encoding processing in S4, starts transmission of video image data to the web conference server 1104 in S5, and transmits a preview video in S6.

The video transmission quality setting in S7 is requested when the setting is made by the user, and the video keep-alive transmission in S8 is periodically performed.
When video transmission becomes unnecessary, such as when there is no other party to be transmitted, a video image transmission stop request is made in S9. By making this stop request, the video transmission thread 1103 ends the loop of L2.

Next, a video reception process in which the information processing apparatus 100 receives a screen of another information processing apparatus from the web conference server using S10 to S19 will be described. This process is the opposite of the video transmission process and receives the video transmitted by the video transmission process.
When a video reception start request is made in S10, the main thread 1102 starts video reception in S11, and the video reception thread 1105 makes a video transmission request to the web conference server 1104 in S11.1.

The video reception start request corresponds to, for example, the image acquisition request processing in step S906 in FIG.
The reception request is a video reception start request using the opposite session ID to be displayed in the cell. For example, it is possible to use an ID assigned to a media unit of a device such as video or audio of each user.

The video reception thread 1105 that has received the video reception request starts receiving video image data in S12 until receiving a video reception stop request in S19, receives the opposite video image from the web conference server 1103 in S13, and receives the video image in S14. Decode data. This process is repeated as a loop L3 until a video reception stop request is made in S19.
In S15, the decoded data is stored in the video image queue, and the process of receiving the video image in S16 is repeated in loop L4 until the opposite video reception stop request in S18 is received.

When an opposing video image request is received from the screen display thread 1101 in S17, an image having a session ID corresponding to the opposing video image is drawn in S17.1.
When the opposite video reception stop request is made in S18, the main thread 1102 makes a video reception stop request to the S19 video reception thread, and the request to the web conference server 1103 is stopped.

The video reception stop request in S18 corresponds to, for example, step S805 in FIG. 8 and the like, and the reception stop is performed when the cell is changed from the display to the non-display state after scrolling the screen. The session ID described above is used as an argument for stopping.
A reception stop request is also made when there is no cell due to the opposite exit.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system including a single device.

  The program according to the present invention is a program that can be executed by a computer according to the processing method of the flowchart shown in the present invention. The storage medium according to the present invention stores a program that can be executed by a computer. The program in the present invention may be a program for each processing method of each device.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk, solid state drive, or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 110 Network 200 Web conference server 300 Information processing apparatus 310 Information processing apparatus

Claims (9)

An information processing apparatus capable of displaying content distributed from a server via a network in a predetermined display area,
Content acquisition request start means for making an acquisition request for the content displayed in the display area to the server;
Display change receiving means for receiving an instruction to change the display position of the content displayed in the display area;
First content specifying means for specifying content that has been displayed in the display area before the start of changing the display position of the content according to the change instruction of the display position;
When the content specified by the first content specifying unit is not displayed in the display area after the change of the display position of the content by the display position change instruction is completed, an acquisition request to the server for the non-displayed content Acquisition request stop means for stopping
An information processing apparatus comprising: Second content specifying means for specifying the content displayed in the display area when the change of the display position of the content by the change instruction ends;
When the content specified by the second content specifying means is not included in the content specified by the first content specifying means, the content acquisition request starting means starts a content acquisition request, If the content specified by the second content specifying means is included in the specifying means specified by the first content specifying means, content that continues the acquisition request without making a new acquisition request by the content acquisition request starting means Acquisition request control means;
The information processing apparatus according to claim 1, further comprising: When the content acquired by the first content specifying unit is not included in the content specified by the second content specifying unit, the final acquired image that stores the last image acquired from the server as the final acquired image Storage means,
The information processing apparatus according to claim 2, further comprising:   When the content whose acquisition request has been stopped by the acquisition request stop unit is displayed in the display area, the final acquisition stored by the final acquired image storage unit until the content is acquired by the content acquisition request start unit The information processing apparatus according to claim 3, wherein an image is displayed in the predetermined display area. A determination means for determining whether the content displayed in the display area is completely displayed without interruption;
The content acquired by the first content acquisition unit and the second content acquisition unit is a content in which the content is completely displayed by the determination unit. The information processing apparatus according to item. Content information storage means for storing the coordinates of the display area and the size and coordinate position of the content;
The information processing apparatus according to claim 5, wherein the determination unit determines whether the content is completely displayed according to a size and a coordinate position of the content with respect to the display area stored in the storage unit. The distributed content consists of main content displayed as a main image and sub-content displayed as a sub-image,
The information processing apparatus according to claim 1, wherein the predetermined display area is an area in which a plurality of the sub contents can be displayed. A method for controlling an information processing apparatus capable of displaying content distributed from a server via a network in a predetermined display area,
A content acquisition request start step for making an acquisition request for the content displayed in the display area to the server;
A display change receiving step for receiving an instruction to change the display position of the content displayed in the display area;
A first content specifying step of specifying content that has been displayed in the display area from before the start of changing the display position of the content by the display position change instruction;
When the content specified by the first content specifying step is not displayed in the display area after the change of the display position of the content by the display position change instruction is completed, an acquisition request to the server for the non-displayed content Acquisition request stop step to stop,
A method for controlling an information processing apparatus, comprising: A program that can be executed by an information processing apparatus capable of displaying content distributed from a server via a network in a predetermined display area,
The information processing apparatus;
Content acquisition request start means for making an acquisition request for the content displayed in the display area to the server;
Display change receiving means for receiving an instruction to change the display position of the content displayed in the display area;
First content specifying means for specifying content that has been displayed in the display area before the start of changing the display position of the content according to the change instruction of the display position;
When the content specified by the first content specifying unit is not displayed in the display area after the change of the display position of the content by the display position change instruction is completed, an acquisition request to the server for the non-displayed content Acquisition request stop means for stopping
A program for causing a computer to function as an information processing apparatus.

Images