JP6040144B2 - Display control device, display control method, and display control program - Google Patents

Description

  The present invention provides a display control for automatically scrolling a display in a screen area of another terminal in conjunction with a scroll operation performed on a display in the screen area of one terminal among a plurality of connected terminals. The present invention relates to a device, a display control method, and a display control program.

  Conventionally, when a plurality of users browse the same content using an information system, when the display content is scrolled on the terminal of one user (for example, a lecturer who conducts a lecture), the scroll operation is performed. In conjunction with this, there is a technique for automatically scrolling the display content on the terminal of another user (for example, a student who takes a lecture) (for example, Non-Patent Document 1).

  The technology described in Non-Patent Document 1 is performed on content displayed by a browser of one terminal by building a system based on a server / client model by connecting individual terminals (client terminals) to a Web server. By transmitting the information related to the scroll operation to another terminal via the Web server, the content displayed on the destination terminal is scrolled in synchronization.

  Specifically, using a communication protocol such as WebSocket (\ url {http://www.websocket.org/}), the browser information necessary for conversion of the scroll event and scroll amount of the browser in each terminal is displayed on the Web. Notify the server, execute JavaScript (\ url {https://developer.mozilla.org/en/docs/Web/JavaScript}) on the web server to convert the scroll amount, and use WebSocket on other terminal browsers. Is used to notify the conversion value of the scroll amount, and the scroll bar is moved by the browser of each terminal.

Daisuke Nakamura, Teruo Hamada, “Web browsing collaborative system that enables practical sharing of page operations”, FIT 2009 (8th Information Science and Technology Forum)

  However, in the server-client model system as described above, if the scroll operation of the display content is synchronized between a plurality of terminals, while the scroll operation is performed on a certain client terminal, the client terminal It is necessary to constantly notify the web server of information related to the scroll operation at predetermined time intervals.

  For this reason, there is a problem that the number of times of notification of operation information from the client terminal where the scroll operation is performed to the Web server becomes enormous, and the amount of communication in the system increases, which may hinder communication.

  In the system, information indicating the amount of crawl is continuously notified from the Web server to the synchronization control destination client terminal at predetermined time intervals.

  For this reason, there is a problem that the number of times of notification of information for instructing the scroll amount from the Web server to the synchronous control destination client terminal becomes enormous, and the amount of communication in the system increases, which may hinder communication.

  The present invention has been made in view of the above circumstances, and, among a plurality of connected terminals, in conjunction with a scroll operation performed on a display within the screen area of one terminal, An object of the present invention is to provide a display control device, a display control method, and a display control program capable of performing processing with high accuracy while suppressing the amount of communication with each terminal when automatically scrolling the display in the screen area. And

  In order to solve the above-described problem, the display control device of the present invention is linked to a scroll operation performed on the display in the screen area of one terminal among a plurality of connected terminals, In the display control apparatus that automatically scrolls the display in the screen area of the terminal, the scroll information acquisition unit that acquires the operation information at the initial stage of the scroll operation executed on the one terminal, the scroll information acquisition unit, Based on the operation information at the initial stage of the scroll operation, the scroll speed of the subsequent scroll operation at the one terminal is estimated, and the scroll speed at the other terminal is determined at predetermined time intervals from the estimated scroll speed at the one terminal. And a scroll speed update unit that calculates and transmits the result to the other terminal.

  In addition, the display control method of the present invention allows the display in the screen area of another terminal to be linked to the scroll operation executed for the display in the screen area of one terminal among a plurality of connected terminals. The display control device for automatically scrolling acquires the operation information at the initial stage of the scroll operation executed at the one terminal, and the subsequent scroll at the one terminal based on the acquired operation information at the initial stage of the scroll operation. A step of estimating an operation scroll speed, calculating a scroll speed at the other terminal at a predetermined time interval from the estimated scroll speed at the one terminal, and transmitting to the other terminal. To do.

  According to the display control device, the display control method, and the display control program of the present invention, among the plurality of connected terminals, in conjunction with the scroll operation executed for the display in the screen area of one terminal. The display in the screen area of another terminal can be automatically scrolled.

It is a block diagram which shows the structure of the display system using the content display control apparatus by 1st Embodiment of this invention. It is explanatory drawing which shows the display screen of the operation client terminal connected to the content display control apparatus by 1st Embodiment of this invention, and the display screen of a control destination client terminal. It is a flowchart which shows operation | movement of the scroll information notification part of the content display control apparatus by 1st Embodiment of this invention. It is a table | surface which shows an example of the browser information stored in browser information DB of the content display control apparatus by 1st Embodiment of this invention. It is a table | surface which shows an example of the operation information stored in operation information DB of the content display control apparatus by 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the initial stage scroll amount calculation part in the content display control apparatus by 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the scroll speed update part in the content display control apparatus by 1st Embodiment of this invention. It is a graph which shows the regression line calculated from the acquired operation information in the scroll speed update part of the content display control apparatus by 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the scroll completion | finish process part in the content display control apparatus by 1st Embodiment of this invention.

  As an embodiment of the present invention, the same content is displayed on one client terminal used by user A and another client terminal used by user B, and scroll operation performed by user A using the client terminal A display system that automatically scrolls the display on the client terminal of user B will be described in conjunction with FIG.

  Hereinafter, a client terminal on which the user A performs a scroll operation is referred to as an “operation client terminal”, a terminal that the user B browses, and a client terminal that is a scroll control destination is referred to as a “control destination client terminal”.

  In the following embodiment, the “scroll amount” at a certain time refers to the content displayed at the time during the scroll operation from the position in the content displayed immediately before the start of the scroll operation with respect to a predetermined position on the display screen. Indicates the amount of movement to the inner position.

<< First Embodiment >>
<Configuration of Display System Using Content Display Control Device according to First Embodiment>
A configuration of a display system using the content display control apparatus according to the first embodiment of the present invention will be described with reference to FIG.

  The display system 1 according to the present embodiment includes an operation client terminal 10 operated by a user A (for example, a lecturer who performs a lecture) and a control destination client operated by a user B (for example, a student who takes a lecture). The terminal 20 includes a content display control device 30 connected to the operation client terminal 10 and the control target client terminal 20.

  The operation client terminal 10 includes a monitor 11 that displays content, a browser 12 that controls display of content on the monitor 11 (the browser ID in the system is “A”, hereinafter referred to as “browser A”), When the user A performs an operation for scrolling the content displayed in the display window in the monitor 11, this is detected, and scroll information necessary for calculating the scroll amount of the scroll operation is acquired at predetermined time intervals. It has the scroll information acquisition part 13 and the scroll information transmission part 14 which transmits the scroll information acquired by the scroll information acquisition part 13 to the content display control apparatus 30.

  The scroll information acquired by the scroll information acquisition unit 13 includes operation information I (t) at time t when t seconds have elapsed from the start of the scroll operation. The operation information I (t) is information that changes with time during the scroll operation. For example, in the case of a scroll operation that moves the scroll bar displayed on the screen, coordinate information indicating the operation position on the screen, mouse information In the case of the scroll operation for rotating the wheel button, the scale position information of the wheel button is used. The scroll information includes information for calculating which part of the content is displayed at a predetermined position of the operation target display window, and a scroll end notification when it is detected that the scroll operation has ended.

  The control destination client terminal 20 includes a monitor 21 that displays content, and a browser 22 that controls display of the content on the monitor 21 (the browser ID in the system is “B”, hereinafter referred to as “browser B”). A scroll speed information receiving unit 23 that receives scroll amount information related to the operation client terminal 10 from the content display control device 30 and a display control unit 24 that scrolls the content displayed on the monitor 21 at a speed based on the received scroll amount information. And have.

  The content display control device 30 includes a scroll information notification unit 31, an operation information storage unit 32, a browser information storage unit 33, an initial scroll amount calculation unit 34, a scroll speed update unit 35, and a scroll end processing unit 36. Have.

  The scroll information notification unit 31 acquires scroll information transmitted from the operation client terminal 10.

  The operation information storage unit 32 stores an operation information DB that stores operation information I (t) included in the scroll information regarding the operation client terminal 10 acquired by the scroll information notification unit 31.

  The browser information storage unit 33 stores a browser information DB that stores browser information of the operation client terminal 10 and the control target client terminal 20. The browser information includes size information of a display window displaying the content X by each browser.

  The initial scroll amount calculation unit 34 is based on the operation information I acquired by the scroll information notification unit 31 from when the scroll operation is started at the operation client terminal 10 until the predetermined period T elapses. The scroll amount at the terminal 20 is calculated. The calculated scroll amount information is transmitted to the control target client terminal 20.

  The scroll speed update unit 35 estimates the estimated scroll speed in the browser A after the predetermined period T based on all the operation information I stored in the operation information DB when the predetermined period T comes from the start of the scroll operation. And the control scroll speed at the control target client terminal is calculated at predetermined time intervals based on the calculated estimated scroll speed at the browser A. The calculated control scroll speed information is transmitted to the control target client terminal 20.

  When the scroll end processing unit 36 determines that the scroll operation has ended based on the scroll information acquired by the scroll information notifying unit 31, the scroll end processing unit 36 performs a scroll end process.

<Operation of Display System Using Content Display Control Device According to First Embodiment>
Next, in the display system 1 according to the present embodiment, the content is displayed on the monitor 21 of the control target client terminal 20 in conjunction with the scroll operation performed on the content displayed on the monitor 11 of the operation client terminal 10. The operation of scrolling the content that is currently being described will be described.

  First, as shown in FIG. 2, the browser A is activated in the operation client terminal 10 of the display system 1 to display a predetermined content in the display window in the monitor 11, and the browser B is activated in the control destination client terminal 20 to be monitored. The predetermined content is displayed in the display window 21. In the present embodiment, the same content X is displayed on the monitor 11 of the operation client terminal 10 and the monitor 21 of the control target client terminal 20.

  While the content X is displayed on the display window in the monitor 11 of the operation client terminal 10, the user A performs a scroll operation on the display of the content X in the display window using a user interface device such as a mouse. Then, this operation is detected in the scroll information acquisition unit 13.

  When the scroll information acquisition unit 13 detects a scroll operation, the scroll information acquisition unit 13 acquires scroll information at a predetermined time interval (for example, 0.01 second interval).

  The scroll information acquired by the scroll information acquiring unit 13 is transmitted to the content display control device 30 by the scroll information transmitting unit 14.

  The scroll information transmitted from the operation client terminal 10 is acquired by the scroll information notification unit 31 of the content display control device 30.

  A process executed by the scroll information notification unit 31 when the scroll information is acquired will be described with reference to the flowchart of FIG.

  First, the scroll information notifying unit 31 acquires the scroll information transmitted from the operation client terminal 10 at time t (0.01) immediately after the start of the scroll operation (S1).

  Next, it is determined whether or not the number of records in the browser information DB in the browser information storage unit 33 is “0” (S2).

  Here, since it is immediately after the start of the scroll operation, the number of records is “0” (“YES” in S2), and the respective browser information is acquired from all client terminals (operation client terminal 10 and control target client terminal 20). Is stored in the browser information DB (S3). The browser information includes size information of a display window displaying the content X by each browser.

An example of browser information stored in the browser information DB is shown in FIG. In Figure 5, as the browser information for operating the client terminal 10, the window size wa (wa _x, wa _y) of the display window that displays the content X in the browser A is stored, as a browser information in the control destination client terminal 20, window size wb (wb _x, wb _y) of the display window that displays the content X in the browser B is stored. Here, wa _x, wb _x respectively indicate the horizontal window size of the display window, wa _y, wb _y respectively indicate the vertical direction of the window size of the display window.

  The scroll information acquired in step S1 includes operation information I (0.01) for calculating the scroll amount at time t (0.01) and information of the browser ID “Browser A”. Is stored in the operation information DB of the operation information storage unit 32 as shown in FIG. 4 (S4).

  When the operation information I or the like is stored in the operation information DB, the scroll information notification unit 31 notifies the initial scroll amount calculation unit 34 of the operation information I (0.01) and time t (0.01) of the browser A (S5). ).

  When the scroll information immediately after the start of the scroll operation is acquired as described above, the process executed in the scroll information notification unit 31 ends, and the process returns to step S1 and is continued.

  When scroll information is sequentially transmitted from the operation client terminal 10 while the scroll operation is continued, the scroll information notification unit 31 acquires the scroll information (S1).

  At this time, since the browser information of all browsers is already stored in the browser information DB and the record is not “0” (“NO” in S2), the process proceeds to step S6, and the time t is a preset threshold value. It is determined whether or not T is exceeded (S6). The threshold T is a value indicating a period set in advance in order to determine whether the time t is within the initial scroll amount calculation process target period.

When the acquired time t does not exceed the threshold T (“NO” in S6; initial period of scroll operation start), the operation information I (0.02, 0.03... T ₁ included in the acquired scroll information). ) Is stored in the operation information DB of the operation information storage unit 32 together with the browser ID “Browser A” (S4).

  In addition, the scroll information notification unit 31 notifies the initial scroll amount calculation unit 34 of the operation information I (t) of the browser A and the time t (S5).

  In step S6, when it is determined that the acquired time t exceeds the threshold T (“YES” in S6; after the initial period of the scroll operation starts), a scroll end notification is sent to the acquired scroll information. Is included (S7). If the scroll information does not include the scroll end notification (“NO” in S7), the process returns to step S1, and steps S1, S2, S6, and S7 are repeated until the scroll end notification is acquired.

When scroll information at the end of the scroll operation (t ₂ ) is acquired and it is determined in step S7 that the scroll end notification is included (“YES” in S7), the scroll speed update unit 35 has finished the scroll operation. And the operation information I included in the scroll information is notified to the scroll end processing unit (S8).

  Refer to the flowchart of FIG. 6 for the initial scroll amount calculation process executed by the initial scroll amount calculation unit 34 when the operation information I (t) of the browser A and the time t are notified by the process of step S5 described above. To explain.

  When the operation information I (t) and the time t are acquired from the scroll information notification unit 31 (S11), an initial scroll amount calculation process is started, and it is determined whether or not the time t has reached the threshold value T. (S12).

  When the time t does not reach the threshold T and is within the initial scroll amount calculation processing period (“NO” in S12), the browser information of the browser A and the browser information of the unprocessed browser B other than the browser A Is acquired from the browser information DB (S13).

Next, using the acquired operation information I (t) of the browser A and browser information of the browsers A and B, a scroll operation amount s _A up to the time t in the browser _A is calculated. _A control scroll amount s _B (scroll speed) at time t in browser B corresponding to s _A is calculated (S14).

This control scroll amount s _B can be easily calculated using a known method. For example, as shown in FIG. 5, the window size of the display window displayed in the browser A is wa (wa _x , wa _y ), The scroll amount in the x-axis direction of the scroll operation amount s _A at time t (0.01) is X _A , the scroll amount in the y-axis direction is Y _A , and the window displayed in the browser B If the window size is _{wb (wb x, wb y)} , x -axis direction of the control scroll amount X _B, and the y-axis direction of the control scroll amount Y _B of the control scroll amount s _B in the browser B is represented by the following Calculated by equations (1) and (2).

  Here, if there is an unprocessed record related to the browser of another control target client terminal in the browser information DB, the processes of steps S13 and S14 are similarly executed ("YES" in S15).

The calculated control scroll amount s _B (scroll speed) is transmitted to the corresponding control target client terminal 20 (S16).

In the control destination client terminal 20, the scroll speed information received from the content display control device 30 is received by the scroll speed information receiving unit 23, and the control scroll amount s _B thereafter is determined by the display control unit 24 based on the scroll speed for a predetermined time. Calculated at intervals. Then, the content X displayed in the window is automatically scrolled at a scroll speed based on the calculated control scroll amount s _B.

  If it is determined in step S12 that the time t has reached the threshold T (“YES” in S12), the time t (= T) is notified to the scroll speed update unit 35 (S17).

  Thus, when the scroll information is acquired in the initial scroll amount calculation process target period, the process executed in the initial scroll amount calculation unit 34 is completed.

  The scroll amount estimation process executed by the scroll speed update unit 35 when the time t is notified by the process of step S17 described above will be described with reference to the flowchart of FIG.

  When the time t is acquired from the initial scroll amount calculation unit 34 (S21), browser information of the browser A and browser information of an unprocessed browser B other than the browser A are acquired from the browser information DB (S22).

Next, all the operation information I of the browser A up to the notified time t is acquired from the operation information DB, and the period in the browser A using the operation information I of the browser A and the browser information of the browser A An estimated scroll amount c _A (scroll speed) at an arbitrary time t ₃ (T ≦ t ₃ ) after T is calculated (S23).

Here, assuming that the elapsed time and the scroll operation amount are in a proportional relationship, the estimated scroll amount c at time t ₃ based on the operation information I for the period T from the start of the scroll operation stored in the operation information DB. _A is obtained as follows. For example, among the estimated scroll amount c _A, the estimated amount of scrolling x axis direction is C _Ax, when the estimated amount of scrolling in the y-axis direction is assumed to be C _Ay, estimated scroll amount C _Ax at time t _3, C _Ay but is determined from the regression line _{C Ax (t 3) = a} x × t 3 + b x, C Ay (t 3) = a y × t 3 + b y.

  For example, when the scroll amount calculated from the operation information I by the browser A is obtained as a graph indicated by a solid line in FIG. 8, a regression line as indicated by a dotted line is calculated as a straight line approximated to the value of this graph. .

  A known method can be applied to the calculation of the regression line, and even when there is no proportional relationship between the elapsed time and the scroll operation amount, by using a known nonlinear regression method such as logistic regression, the time t The estimated scroll amount in browser A after = T can be easily obtained.

  When the estimated scroll amount in the browser A is calculated, browser information of an unprocessed browser B other than the browser A is acquired from the browser information DB (S24).

Next, the control scroll amount s _B (scroll speed) of the browser B at the time t is calculated using the estimated scroll amount c of the browser A and the browser information of the browsers A and B (S25). .

  Here, if there is an unprocessed record related to the browser of another control target client terminal in the browser information DB, the processes of steps S24 and S25 are similarly executed (S26).

The calculated control scroll amount s _B (scroll speed) is transmitted to the corresponding control target client terminal 20 (S27).

  Next, after a predetermined time elapses from the transmission of the control scroll amount (“YES” in S28), the scroll information notifying unit 31 does not notify the end of the scroll operation in step S8. (“NO” in S29), the processing of steps S24 to S28 is repeated, and the control scroll amount is calculated and transmitted periodically (every predetermined time). At this time, by setting the scroll information to be transmitted from the content display control device 30 at an interval longer than the time interval at which the scroll information is acquired in the scroll information notification unit 31, the content display control device 30 and the control destination client The amount of communication with the terminal 20 can be reduced.

  When it is notified in step S29 that the scroll operation has ended ("YES" in S29), the process ends.

Further, the scroll end processing executed by the scroll end processing unit 36 when the operation information I (t ₂ ) of the browser A is notified from the scroll information notification unit 31 by the process of step S8, refer to the flowchart of FIG. To explain.

When the operation information I (t ₂ ) is acquired from the scroll information notification unit 31 (S31), scroll end processing is started, and browser information of the browser A and browser information of the unprocessed browser B other than the browser A are stored in the browser. Obtained from the information DB (S32).

Next, using the acquired operation information I (t ₂ ) of the browser A and browser information of the browsers A and B, the control scroll amount s at the time t ₂ in the browser B is performed by the same processing as step S14. _B is calculated (S33).

  Here, if there is an unprocessed record related to the browser of another control target client terminal in the browser information DB, the processes of steps S32 and S33 are similarly executed (S34).

The calculated control scroll amount s _B is transmitted to the corresponding control target client terminal 20 (S35).

In the control destination client terminal 20, the display in the browser B is displayed so that the content X is displayed at the same position as the display position at the end of the scroll operation in the browser A by the control scroll amount s _B transmitted in the process of step S35. Controlled and automatic scrolling is stopped.

  Further, the scroll end processing unit 36 deletes the records of the browser information DB and the operation information DB to make them empty (S36).

  In the content display control apparatus according to the present embodiment described above, when the display on the control target client terminal is automatically scrolled in conjunction with the scroll operation on the operation client terminal, the scroll speed of the operation client terminal at the initial stage of the operation start. From the content display control device to the control destination client terminal, the scroll speed at the operation client terminal after the period is estimated and automatic scrolling is performed at the control destination client terminal at predetermined time intervals based on the estimation result. The amount of communication can be reduced.

  In the scroll end process, since the display of browser B is matched with the display position of browser A at the end of the scroll operation and the scroll control is stopped, the display position is slightly changed by the approximation process during the scroll operation. Even if a shift occurs, all the client terminals can be stopped at the same display position at the end of scrolling.

  In the above embodiment, the content display control device 30 transmits scroll information during the scroll operation from the operation client terminal 10 to the content display control device 30 when it is determined in step S12 that the time t has reached the threshold value T. May be stopped, or the transmission interval may be lengthened, and an instruction may be sent to the operation client terminal 10 so that the scroll information when the scroll operation is completed is transmitted quickly.

  By giving instructions in this way, the amount of communication from the operation client terminal 10 to the content display control device 30 can also be reduced, and the communication load can be further reduced as a whole system.

  Moreover, it is also possible to construct a content display control program that causes the computer to function as a content display control device by programming the functional configuration of the content display control device in the above embodiment into a computer.

DESCRIPTION OF SYMBOLS 1 ... Display system 10 ... Operation client terminal 11 ... Monitor 12 ... Browser 13 ... Scroll information acquisition part 14 ... Scroll information transmission part 20 ... Control destination client terminal 21 ... Monitor 22 ... Browser 23 ... Scroll speed information reception part 24 ... Display control Unit 30 ... Content display control device 31 ... Scroll information notification unit 32 ... Operation information storage unit 33 ... Browser information storage unit 34 ... Initial scroll amount calculation unit 35 ... Scroll speed update unit 36 ... Scroll end processing unit

Claims (4)

In a display control device that automatically scrolls the display in the screen area of the other terminal in conjunction with the scroll operation performed on the display in the screen area of the one terminal among the plurality of connected terminals,
A scroll information acquisition unit for acquiring operation information at an initial stage of a scroll operation executed on the one terminal;
Based on the operation information at the initial stage of the scroll operation acquired by the scroll information acquisition unit, the scroll speed of the subsequent scroll operation in the one terminal is estimated, and from the estimated scroll speed in the one terminal, the A scroll speed update unit that calculates a scroll speed at another terminal at predetermined time intervals and transmits the calculated speed to the other terminal;
A display control apparatus comprising: The display control apparatus according to claim 1, wherein the scroll speed update unit calculates a scroll speed in the one terminal using a regression line obtained from operation information at an initial stage of the scroll operation. A display control device that automatically scrolls the display in the screen area of the other terminal in conjunction with the scroll operation performed on the display in the screen area of the one terminal among the plurality of connected terminals,
Obtaining operation information at the initial stage of the scrolling operation performed on the one terminal;
Based on the acquired operation information at the initial stage of the scroll operation, the scroll speed of the subsequent scroll operation in the one terminal is estimated, and the scroll speed in the other terminal is calculated from the estimated scroll speed in the one terminal. A display control method comprising: calculating at a predetermined time interval and transmitting to the other terminal.   A display control program for configuring the display control device according to claim 1 or 2 by a computer.

Images