JP5697513B2 - Server in screen transfer system and control method thereof - Google Patents

Description

  The present invention relates to a server in a screen transfer system and a control method therefor, and more particularly to a technique for improving usability of a client terminal when a client screen is generated by cutting out a server screen.

  In a server-client type computer system, there is a “screen transfer system” in which a client displays a desktop screen generated by a server. As an example of the hardware architecture of such a screen transfer system, a desktop personal computer may be used on the server side and a so-called smartphone may be used on the client side.

  The above hardware architecture is an example, but if the client is a mobile terminal such as a smartphone, there is a merit because the user can carry the client and use it on the go. However, the mobile terminal usually has a demerit that the screen resolution on the client side is lower than that on the server side.

  Since the screen resolution on the client side is low, in order to improve the operability for the user, for example, it is necessary to display the entire desktop screen in a reduced size or to cut out and display (trim) a part. The present invention is a technique corresponding to the latter problem, that is, a problem that arises when a part of a desktop screen is cut out and displayed.

  Patent Document 1 is considered to describe an example of a screen transfer system that cuts out and displays a part of the desktop screen as described above. In Patent Literature 1, the client device receives “drawing data G” from the server device and displays a part thereof. Information on the displayed screen area (“display area information”) is transmitted to the server apparatus. The server device determines whether or not the “selected object” fits in the displayed screen area, changes the “display area information”, and sends it back to the client. An “object” is a list box, a text box, or the like (see paragraph 0028), and selecting it is understood to indicate indicating as an operation target.

JP 2009-223831 A

  In general, the client display screen is smaller than the desktop screen. For this reason, there has been a problem that the caret may be removed from the client display area when character input is continued by keyboard input. If the caret is out of the client display area, the input cannot be confirmed, which is inconvenient. In addition, even when the selectable item is moved by keyboard input (movement by pressing the Tab key, etc.), there is a problem that the caret is detached from the client display area.

  Therefore, in view of the above circumstances, an object of the present invention is to provide a server in a screen transfer system and a control method thereof in which a client display area can appropriately follow a caret movement.

In order to achieve the above object, as a first aspect, the present invention provides a server screen in the screen transfer system in which a client terminal and a server are communicably connected via a network, and generates a desktop screen. Generation means; screen cutout means for cutting out a part from the desktop screen to form a client screen which is a display area in the client terminal; and detecting an input event in which a character input caret included in the desktop screen moves, and the character input Caret movement control means for determining that the caret has moved to the outside of the client screen, and when it is determined that the character input caret has moved to the outside of the client screen, the cutout position of the client screen is The input caret is the client The position included in the preparative screen, determined, and the screen extraction position determining means for inputting the determined cut position on the screen clipping unit, the character input caret after the caret movement control means moves by the input event detected Storage means for storing a plurality of coordinates , wherein the caret movement control means analyzes the movement trajectory of the character input caret based on the storage contents of the storage means, and the screen cutout position determination means includes the caret Adjusting the cutout position of the client screen based on the moving direction and moving amount of the character input caret analyzed by the movement control means, and inputting the adjusted position as the determined cutout position to the screen cutout means, The screen cutout unit is configured to input the determined cutout position based on the input cutout position. And performing a portion of the cut from desktop screen, there is provided a server in a screen transfer system.

In order to achieve the above object, according to a second aspect of the present invention, there is provided a server control method in a screen transfer system for transferring a part cut out from a desktop screen generated by a server to a client terminal as a client screen. And storing a plurality of coordinates of the character input caret after being moved by the input event detected in the step of detecting an input event in which the character input caret included in the desktop screen is moved and in the step of detecting the input event. A storage step, a caret movement determination step for determining that the character input caret has moved to the outside of the client screen as a result of the detection step, and a movement of the character input caret based on the storage content in the storage step. From the locus, the moving direction and movement of the character input caret A step of analyzing, when the character input caret is determined to have moved to the outside of the client window, the cutout position of the client window, in terms of the character input caret has a position contained in the client screen Furthermore, from the desktop screen based on the determined cutout position, the screen cutout position determining step to determine the position adjusted based on the moving direction and the moving amount of the character input caret analyzed by the analyzing step from the position The present invention provides a method for controlling a server in a screen transfer system, which includes a step of performing partial cutout.

  According to the present invention, the client display area can appropriately follow the caret movement.

It is a block diagram which shows the function structure of 1st Embodiment. It is a conceptual diagram for demonstrating the concept of the server screen in 1st Embodiment, a client screen, and a caret. It is a flowchart figure which shows the flow of a process of 1st Embodiment. It is a flowchart figure which shows the flow of a process of 2nd Embodiment. It is a conceptual diagram for demonstrating the screen cut-out position determination by the cursor key in 2nd Embodiment, or character conversion confirmation key input. It is a conceptual diagram for demonstrating the screen clipping position determination by Tab key input in 2nd Embodiment. It is a block diagram which shows the function structure of 3rd Embodiment.

Hereinafter, preferred embodiments for carrying out the present invention will be described.
The present embodiment is a screen transfer system, and various hardware architectures are conceivable. As an example, a desktop personal computer is used on the server side and a so-called smartphone is used on the client side. In FIG. 1, “server 200” corresponds to a desktop personal computer, and “portable terminal 100” corresponds to a smartphone.

(First embodiment)
FIG. 1 shows a functional configuration of the present embodiment.
In the screen transfer system according to the present embodiment, the server 200 and the mobile terminal 100 are connected via a network so that they can communicate with each other. The server 200 and the portable terminal 100 are configured by each means described below by program control.

  The server 200 includes server screen generation means 201, screen cutout means 202, caret movement control means 203, and screen cutout position determination means 204. The functions of the caret movement control unit 203 and the screen cut-out position determination unit 204 will be described in detail after explanation of each part of the mobile terminal 100.

  The server screen generation unit 201 has a function of sequentially generating the server screen Gs based on the result of information processing by the server 200, the user input received from the mobile terminal 100, and the like. In the present embodiment, the server screen Gs is the desktop screen itself of the OS (basic software) of the server 200 that provides a GUI (graphical user interface).

In FIG. 2, the conceptual diagram for demonstrating the concept of the server screen in this embodiment, a client screen, and a caret is shown.
The server screen Gs is a desktop screen, and the origin (0, 0) is placed in the upper left corner, for example. A character input caret (hereinafter simply referred to as “caret”), which is one of the drawing objects on the desktop screen, can be identified by coordinates (x, y).

  The client screen Gc is a display area (client display area) that can be displayed by the client screen display means 101 in the server screen Gs. Since the client screen Gc is generally rectangular, the position can be specified by the upper left corner coordinates (cx, cy) and the height h and width w of the client display area. When the height h and the width w do not change, the position can be specified only by the upper left corner coordinates (cx, cy).

  The screen cutout position determining unit 204 determines information for specifying the position of the client screen Gc and inputs the information to the screen cutout unit 202. The screen cutout unit 202 cuts out an area (client display area) corresponding to the client screen Gc from the server screen Gs based on the input information specifying the position of the client screen Gc. The screen cutout unit 202 transmits the client screen Gc, which is a cutout image, to the mobile terminal 100 by performing compression encryption or the like.

  The portable terminal 100 includes client screen display means 101 and user input means 102.

  The client screen display unit 101 includes, for example, a liquid crystal display device, and displays the client screen Gc received from the server 200 on the display device.

  The user input unit 102 has a function of generating a user input signal based on an operation input (user operation) by a user and inputting the user input signal to the mobile terminal 100 or the screen transfer system according to the present embodiment. You may integrate with the display apparatus with which the above-mentioned client screen display means 101 is provided.

  User input signals input by the user input unit 102 are sequentially transmitted to the server screen generation unit 201. For example, when a certain character is input, the character input is reflected on the server screen Gs generated by the server screen generation unit 201. Therefore, it is reflected in the client screen Gc cut out from the server screen Gs. In addition, for example, a cursor movement input is similarly reflected.

  However, when the cursor is moved outside the client screen Gc by a cursor movement input such as a flick operation, for example, the screen cut-out position determination unit 204 newly sets an appropriate appropriate value based on such an input event. Determine the screen cutout position. The determined new screen cutout position can be represented by information for specifying the position of the client screen Gc. The screen cutout position determining unit 204 inputs information for specifying the position of the client screen Gc to the screen cutout unit 202.

  In the present embodiment, not only a cursor movement input such as a flick operation but also an input event in which the caret moves may be monitored instead. The server 200 includes caret movement control means 203. The caret movement control means 203 sequentially detects input events for moving the caret. Then, according to the input event that causes the detected caret to move, the caret movement control unit 203 cuts out the screen when the moved caret coordinates move outside the client screen Gc. Control is performed to send the moved caret coordinates to the position determining means 204 to newly determine an appropriate screen cutout position.

The screen cutout position (upper left corner coordinates (cx, cy) of the client screen Gc) newly determined by the screen cutout position determination unit 204 is determined, for example, by the following equation.
cx = x−w / 2
cy = y−h / 2
In this case, the caret coordinates after the movement are cut out so as to come to the center of the newly cut client screen Gc.

FIG. 3 shows a flow of new determination processing of the cutout position of the client screen Gc according to the caret coordinates in the present embodiment.
As described above, the caret movement control unit 203 sequentially detects input events related to the caret movement from the user input signal input by the user input unit 102. When the caret moves (step S101), the caret movement control unit 203 determines whether the moved caret coordinates are outside the client screen Gc, that is, the client display area (step S102).

  If it is not outside, do nothing. If it is outside, the caret movement control means 203 controls the screen cutout position determination means 204 to determine a new screen cutout position (step S103).

  As a result of such processing, according to the present embodiment, when the character input is continued, the caret does not move out of the client display area, and the client display area can appropriately follow the caret movement. . Therefore, the operability is improved.

(Second Embodiment)
In this embodiment, while performing the same configuration and processing flow as in the first embodiment, the caret movement control unit 203 determines an appropriate movement position of the client screen Gc according to the type of input event to which the caret moves. to decide.

FIG. 4 shows a processing flow of the present embodiment.
Steps S201 and S202 are the same as steps S101 and S102 in FIG.
When the moved caret coordinates are outside the client display area, the caret movement control unit 203 determines whether or not the input event that has moved the caret coordinates is a press of a cursor key or a converted character confirmation key ( Step S203).

  The character conversion confirmation key differs depending on the IM (input method), but the Enter key is the de facto standard. Pressing the Enter key may be detected. When character conversion is automatically performed according to the IM setting, a character conversion event may be detected.

  When the caret is moved by the cursor key or the character conversion confirmation key input, the moving amount of the client screen Gc is reduced (step S204). This is not a mode in which the caret is always located at the center of the new client screen Gc as illustrated in the description of the first embodiment, but the new client display area cut out position of the newly determined client display area. This is a mode in which the area is positioned a little (for example, several characters) from the current client display area.

FIG. 5 shows an explanatory example.
FIG. 5A shows a state when “Today's weather is” is entered in the client screen Gc_prev. FIG. 5B shows a state in which “Today's weather is sunny” is further entered and character conversion is confirmed. The client screen Gc_next based on the screen cut-out position newly determined according to the present embodiment is a location moved by several characters from the client screen Gc_prev on the server screen Gs.

  As described above, according to the present embodiment, when the screen cutout position determining unit 204 moves the screen cutout position by inputting a character, the screen cutout position is such that the input character is closer to the center of the client screen Gc than the caret. Determine the position. More specifically, the cutout position of the client display area is determined so that the caret comes to a position on the right side of the center. Therefore, it becomes easy for the user to grasp the already input characters.

Refer to FIG. 4 again.
When the caret is moved by a key for moving a selectable item such as the Tab key (step S205), the caret position is adjusted so as to be the center left of the client screen Gc (step S206). This is also not a mode in which the caret is always positioned at the center of the new client screen Gc as illustrated in the description of the first embodiment for the newly determined cutout position of the client display area. This is a mode in which the cutout position of the new client display area is adjusted so that the moved caret is center left (in the case of a language in which characters are written from left to right).

  When there are a plurality of selectable items such as an input form and these selections are moved by keyboard input, the caret moves to the next selectable item when a key for moving the selectable item is input. The key for moving the selectable item differs depending on the OS and application program, but the Tab key is the de facto standard.

FIG. 6 shows an explanatory example.
FIG. 6A shows a state before the screen cutout position determination process according to the present embodiment. FIG. 5B shows the client screen Gc_next based on the newly determined screen cutout position when the Tab key is pressed.

  As described above, in this embodiment, when the screen cutout position determination unit 204 moves the screen cutout position by moving a selectable item such as switching the input form, the character to be input from now on the client screen rather than the caret. The screen cut-out position that is closer to the center of Gc is determined. More specifically, the cutout position of the client display area is determined so that the caret comes to a position on the left side of the center. This makes it easier for the user to visually recognize a character to be input.

Refer to FIG. 4 again.
The screen cutout position determination unit 204 determines the screen cutout position based on the determination in step S204 or step S206 (step S207).

(Third embodiment)
FIG. 7 shows a functional configuration of the present embodiment.
This embodiment includes a caret movement storage unit 205 in addition to the configuration of the first or second embodiment. The caret movement storage unit 205 is a buffer that stores a plurality of caret coordinates. The caret movement control unit 203 sequentially detects an input event in which the caret moves, and stores several caret coordinates after the movement in the caret movement storage unit 205.

  Further, the caret movement control unit 203 adjusts a newly determined screen cutout position in accordance with the locus of the caret movement analyzed from the caret coordinates stored in the caret movement storage unit 205. This adjustment is executed immediately before step S103 in FIG. 3 or step S207 in FIG.

Specifically, this adjustment is as follows.
When the trajectory of the caret movement is horizontal and skipping (for example, a caret movement amount equal to or more than a predetermined number of characters such as 10 characters), the caret movement control means 203 is operated once by the operating user. It is determined that the user has a large number of characters to be converted to. Then, the moving amount of the client display area is increased from the default. Here, the moving amount of the client display area indicates the “moving amount” described with reference to FIG.

  As described above, the present embodiment greatly adjusts the movement amount of the cutout start position of the client display area when the interval between movement trajectories analyzed from a plurality of stored caret coordinates is large. Therefore, it is easy to use for a user who has a large number of characters to convert at a time and tends to convert a long sentence at once.

  Further, when the trajectory of the caret movement is in the horizontal direction and the range is narrow (for example, a caret movement amount equal to or less than a predetermined number of characters such as 5 characters), the caret movement control unit 203 is operated. It is determined that a certain user has a small number of characters to be converted at a time. Then, the movement amount of the client display area is reduced from the default.

  As described above, this embodiment adjusts the moving amount of the cutout start position of the client display area to be small when the interval between movement trajectories analyzed from a plurality of stored caret coordinates is narrow. Therefore, the number of characters to be converted at a time is small, and it can be made easier for users who tend to convert with short sentences.

  In addition, when the trajectory of the caret movement is in the vertical direction and is discrete (for example, a caret movement amount equal to or more than a predetermined first distance such as several pixels), the caret movement control unit 203 uses the Tab key. It is determined that the input form is moved (or a selectable item is moved). The character to be input is determined as a screen cutout position that is closer to the center of the client screen Gc than the caret.

  More specifically, the cutout position of the client display area is determined so that the caret comes to a position on the left side of the center. This makes it easier for the user to visually recognize a character to be input. Therefore, the same effect as the process of step S206 in FIG. 4 can be obtained.

  In addition, when the trajectory of the caret movement is in the vertical direction and the range is narrow (for example, a caret movement amount equal to or less than a predetermined second distance such as several pixels), the caret movement control unit 203 uses a cursor key or a character. It is determined that the caret is moved by inputting a conversion confirmation key. Then, the input character is determined as a screen cutout position that is closer to the center of the client screen Gc than the caret.

  More specifically, the cutout position of the client display area is determined so that the caret comes to a position on the right side of the center. Therefore, it becomes easy for the user to grasp the already input characters. Therefore, the same effect as the process of step S204 in FIG. 4 can be obtained.

  The configurations disclosed in the above embodiments can be combined with each other.

DESCRIPTION OF SYMBOLS 100 Mobile terminal 101 Client screen display means 102 User input means 200 Server 201 Server screen generation means 202 Screen cutout means 203 Caret movement control means 204 Screen cutout position determination means 205 Caret movement storage means Gs Server screen Gc Client screen

Claims (6)

The server in the screen transfer system in which the client terminal and the server are communicably connected via a network,
Server screen generating means for generating a desktop screen;
Screen cutout means for cutting out a part from the desktop screen and making it a client screen which is a display area in the client terminal;
A caret movement control means for detecting an input event in which the character input caret included in the desktop screen moves and determining that the character input caret has moved to the outside of the client screen;
When it is determined that the character input caret has moved to the outside of the client screen, the cutout position of the client screen is determined as a position where the character input caret is included in the client screen. A screen cutout position determining means for inputting to the screen cutout means;
Storage means for storing a plurality of coordinates of the character input caret after being moved by the input event detected by the caret movement control means ,
The caret movement control means analyzes the movement trajectory of the character input caret based on the stored contents of the storage means,
The screen cutout position determining unit adjusts the cutout position of the client screen based on the moving direction and the moving amount of the character input caret analyzed by the caret movement control unit, and the adjusted position is set as the determined cutout position. , Input to the screen cutout means,
The server in the screen transfer system, wherein the screen cutout means cuts out a part from the desktop screen based on the input cutout position that has been input. The screen clipping position determining means, the caret movement control means according to the analysis result, when the movement of the coordinate moving amount of an and and the coordinate movement in the lateral direction is equal to or greater than the first threshold value, the movement of the cut-out position and determining to adjust the cut-out position so that the amount is increased, a server in the screen transfer system according to claim 1. The screen clipping position determining means, the caret movement control means according to the analysis result, when the movement of the coordinate moving amount of an and and the coordinate movement in the lateral direction is less than a second threshold value, the movement of the cut-out position and determining to adjust the cut-out position so that the amount is reduced, the server in the screen transfer system according to claim 1 or 2. As a result of analysis by the caret movement control unit, the screen cutout position determination unit determines that the cutout position is determined when the movement of the coordinate is a vertical movement and the movement amount of the coordinate is equal to or greater than a third threshold. The server in the screen transfer system according to any one of claims 1 to 3, wherein the character input caret is determined at a position to be placed to the left of the center of the newly determined client screen. As a result of analysis by the caret movement control unit, the screen cutout position determination unit determines that the cutout position is determined when the movement of the coordinate is a vertical movement and the movement amount of the coordinate is equal to or less than a fourth threshold. The server in the screen transfer system according to any one of claims 1 to 4 , wherein the character input caret is determined at a position on the right side of the center of the newly determined client screen. A server control method in a screen transfer system for transferring a part cut out from a desktop screen generated by a server to a client terminal as a client screen,
Detecting an input event in which a character input caret included in the desktop screen moves; and
A storage step of storing a plurality of coordinates of the character input caret after being moved by the input event detected in the step of detecting the input event;
As a result of the detecting step, a caret movement determining step of determining that the character input caret has moved to the outside of the client screen;
A step of analyzing a movement direction and a movement amount of the character input caret from a locus of movement of the character input caret based on the stored contents in the storage step;
When it is determined that the character input caret has moved to the outside of the client screen, the cut-out position of the client screen is set to a position where the character input caret is included in the client screen, and the analysis is further performed from the position. A screen cut-out position determination step for determining the position adjusted based on the moving direction and moving amount of the character input caret analyzed by the step of
Cutting out a part from the desktop screen based on the determined cut-out position;
A method for controlling a server in a screen transfer system, comprising:

Images