JP6335758B2 - Server, terminal, and screen display method - Google Patents

Description

  The present invention relates to a server, a terminal, and a screen display method.

Because of the widespread use of broadband lines, the restriction on communication bandwidth has been reduced, and applications that share screens between client terminals connected via a network are increasing. Typical examples of systems that use this type of application include, for example, remote desktop (for example, see Non-Patent Document 1), VNC (Virtual Network Computing) (for example, see Non-Patent Document 2), or output function division. And a system (see Patent Document 1).
In these systems, the screen displayed on the sharing source terminal can be shared (viewed and operated) by the sharing destination terminal.

International Publication No. 2014/1226069 Pamphlet

Rieko Masaki, one other person, “Change the screen size of remote desktop connection”, [online], July 6, 2007, [October 8, 2014 search], Internet <http: // www .atmarkit.co.jp / fwin2k / win2ktips / 900rdscrcng / rdscrcng.html> "Default screen resolution and display color settings", "Specify default desktop environment", [online], [October 8, 2014 search], Internet <http://www.obenri.com/_vnc /vnc_server2.html>

  In a screen sharing system, the screen resolution of the sharing source terminal may be different from the screen resolution of the sharing destination terminal. In such a case, it is required to display the screen of the sharing source terminal on the sharing destination terminal after adjusting the screen according to the screen resolution of the sharing destination terminal.

  However, in the technology of Non-Patent Document 1, when the screen resolution of the sharing destination terminal does not match the screen resolution of the sharing source terminal, the screen is changed according to the resolution manually set by the user, or the sharing destination terminal When adjusted according to the screen resolution, the layout of the sharing source screen and the layout of the sharing destination screen are different.

  In the technique of Non-Patent Document 2, the user sets a resolution equal to or lower than the resolution of the sharing source screen (server) or adjusts the screen resolution according to the default value set on the sharing source screen (server). To do.

  However, with the conventional technology, the display of the sharing destination screen cannot be automatically adjusted according to the resolution of the sharing destination screen while maintaining the screen layout of the sharing source terminal. That is, since the resolution of the sharing destination terminal cannot be known at the sharing source terminal, there is a problem that it is not realistic for the user to set the resolution of the sharing source terminal according to the resolution of the sharing destination terminal.

  In addition, when a screen that matches the resolution of the sharing source terminal is displayed on the screen of the sharing destination terminal with a different resolution, the display content on the sharing source terminal is displayed small on the screen, resulting in a blank space, or the entire display is not displayed. , It is not displayed the same as the screen of the sharing source terminal. For this reason, it becomes difficult to operate the screen in the sharing destination terminal, and the usability is deteriorated.

  In addition, when sharing (viewing) a screen that has been scrolled on any of the terminals sharing the screen with all the terminals sharing the screen, scroll from any of the terminals sharing the screen. The time from when the operation event of the operation is sent to the server until all terminals sharing the screen receive the screen is the transmission time of the operation event, after scrolling to send to all terminals sharing the screen The total time for generating the screen data and the time for transferring the screen data to all terminals sharing the screen. For this reason, as the number of terminals sharing the screen increases, it takes longer for all terminals sharing the screen to share (view) the scrolled screen on any of the terminals sharing the screen. Cost. Therefore, in a system (for example, an online game system) that performs an input operation on a screen at each of a sharing source terminal and a sharing destination terminal, there is a possibility that the timing of screen display may be shifted between the terminals, resulting in a decrease in operability. It was.

  The present invention has been made in view of the above-described circumstances, and an object thereof is a server, a terminal, and a screen display method capable of displaying a screen shared by a plurality of terminals without impairing operability. It is to provide.

In order to solve the above problems, the present invention takes the following measures.
In a first aspect of the present invention, screen data to be displayed on the screens of the first terminal and the second terminal is transmitted to the first terminal and the second terminal connected via a network. An operation event receiving means for receiving an operation event for changing a screen from the first terminal; and an operation for transmitting the operation event to the second terminal in response to the operation event. An event transmission means, a first magnification based on a first ratio of screen resolutions in the vertical direction of the first terminal and the second terminal, and the first terminal and the first terminal in response to the operation event; The size of the first screen data displayed on the screen of the first terminal is changed based on one of the second magnifications based on the second ratio of the horizontal screen resolutions of the two terminals. Second screen data A screen data generating means for forming, after transmitting the operation event to the second terminal, while the second terminal is executing a processing according to the operation event, the second screen data to the second terminal A server having screen data transmission control means for transmitting.

According to a second aspect of the present invention, there is provided an operation event receiving unit that receives an operation event in another terminal, a processing unit that executes a process related to the operation event in response to the reception of the operation event, and a screen of the other terminal . Receiving means for receiving the first screen data generated according to the resolution, and the vertical screen resolution of each of the first screen data and the screen of the own terminal while executing the processing related to the operation event Based on one of the first magnification based on the first ratio and the second magnification based on the second ratio of the first screen data and the horizontal screen resolution of the terminal , A terminal having screen data creation means for creating second screen data by changing the size of the first screen data, and screen data display means for displaying the second screen data after processing related to the operation event .

  According to the present invention, it is possible to display a screen shared by a plurality of terminals without impairing operability.

The block diagram which shows the structure of the screen display system in this embodiment. The flowchart which shows the terminal process in this embodiment. The flowchart which shows the screen data creation process in this embodiment. The flowchart which shows the scroll event process in this embodiment. The figure which shows the sequence of the process performed by the terminal and server when the operation event of scroll operation in this embodiment is made. The block diagram which shows the structure of the other screen display system in this embodiment. The block diagram which shows the structure of the other screen display system in this embodiment. The figure which shows the example of application of the screen sharing system in this embodiment.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of the screen display system in the present embodiment. The screen display system according to this embodiment includes a plurality of terminals (a plurality of terminals) connected to the server 10A via a network (NW) 14 such as the Internet via a server 10A that provides a screen transfer service (hereinafter referred to as a server 10A). The client) 12 (12A-1, 12A-2, 12A-3,...) Can share the screen displayed on any of the terminals 12. The screen display system can be realized, for example, as an online game or electronic book system in which a plurality of terminals 12 share a screen.

  The server 10 </ b> A provides a screen transfer service for transferring a screen (screen data) displayed on any of the terminals 12 to another terminal 12 for sharing with the terminals 12 connected via the network 14. Server 10A has various modules which realize a computer, for example. That is, the server 10A includes a recording medium such as a memory and a hard disk device, a processor (CPU (Central Processing Unit) and the like) that executes various programs stored in the memory, various input devices such as a keyboard and a mouse, a display, and a speaker. And an output device such as an external electronic device and a communication device that controls communication with various networks.

  The server 10A implements various functions by executing a basic program (OS (Operating System), etc.) and various programs stored in the recording medium by a processor. The server 10A implements the functions of, for example, the scheduler 22A, the screen data creation unit 24A, and the screen data transmission control unit 26A by executing a service program 20A for providing a screen transfer service by the processor.

  The scheduler 22A causes a predetermined process to be executed when a predetermined timing or a predetermined event occurs. For example, when an operation event generated by a user operation is received at the terminal 12, the scheduler 22A executes a process according to the operation event. When an operation event related to the screen transfer service (an operation event for changing the screen) is received, the scheduler 22A determines a predetermined timing (for example, a timing at which a timer that fires at a certain period next fires) or immediately. The screen data creation unit 24A is instructed to create screen data for screen transfer. When the scheduler 22A receives an operation event (scroll event) corresponding to the screen scroll from any terminal 12, the screen data creation unit 24A causes the other terminal 12 to transmit a scroll position indicating the screen scroll destination. After that, the screen data creation unit 24A immediately creates screen data at a predetermined timing (for example, timing when the timer that fires at a fixed period next fires) or immediately.

The screen data creation unit 24A shares the screen with the terminal 12 that is the transmission source of the operation event (the first terminal that is the sharing source terminal) and the terminal 12 in response to an instruction from the scheduler 22A according to the operation event. The first magnification based on the first ratio of the vertical screen resolution of each of the other terminals 12 (the second terminal as the sharing destination terminal) and the horizontal screen of each of the first terminal and the second terminal The second screen data is created by changing the size of the first screen data displayed on the screen of the first terminal based on one of the second magnifications based on the second ratio of the resolution. In the present embodiment, the screen data creation unit 24A creates second screen data based on the first magnification or the second magnification corresponding to the larger one of the first ratio and the second ratio, for example. The screen data transmission control unit 26A transmits the first screen data created by the screen data creation unit 24A to the first terminal, and the second screen data to the second terminal as the screen sharing destination terminal. Alternatively, as another embodiment, the first screen data can be created by the terminal 12 that is the source of the operation event, and the server can create only the second screen data .

Furthermore, as another embodiment, the screen data creation unit 24A corresponds to the resolution of one of the terminals 12 (for example, the first terminal as a sharing source terminal) according to an instruction from the scheduler 22A according to the operation event. First screen data is created and transmitted to each terminal 12. The first terminal and the second terminal that have received the first screen data have the first magnification based on the first ratio of the first screen data generated by the server and the screen resolution in the vertical direction of the own terminal, and the server The size of the screen data displayed on the screen of the own terminal based on one of the second magnification based on the first screen data generated in step 2 and the second ratio of the horizontal screen resolution of the own terminal. The second screen data with the changed is created. In the present embodiment, for example, the second screen data is created based on the first magnification or the second magnification corresponding to the larger one of the first ratio and the second ratio. Similarly to the above embodiment, the first screen data can be created by the terminal 12 that is the source of the operation event, and only the second terminal can create only the second screen data .

  Further, when creating the second screen data in the second terminal that has received the first screen data, the second terminal receives the scroll position corresponding to the screen scroll operation event in the first terminal, and sets the scroll position first. The screen is scrolled accordingly, and the second screen data after scrolling is generated by the above method based on the resolution of the first screen after scrolling transmitted from the server and the resolution of the own terminal, and the scrolling position is reached. It is also possible to display the generated second screen data after the scrolling is completed.

  Terminals 12 (12A-1, 12A-2, 12A-3,...) Are electronic devices used by the user to use the screen transfer service provided by the server 10A. The terminal 12 is realized by an electronic device such as a personal computer, a slate PC, a smartphone, a mobile phone, or a car navigation system. The terminal 12 has various modules that implement a computer. That is, the terminal 12 includes a recording medium such as a memory and a hard disk device, a processor (CPU (Central Processing Unit) and the like) that executes various programs stored in the memory, various input devices such as a keyboard and a mouse, a display, and a speaker. And an output device such as an external electronic device and a communication device that controls communication with various networks.

  The terminal 12 implements various functions by executing a basic program (such as an OS (Operating System)) and various programs stored in a recording medium by a processor. In the present embodiment, the terminal 12 executes a service program 30A by a processor, thereby using a screen transfer service function provided by the server 10A, a user interface unit 32A, an operation event filter unit 34A, an event transmission unit 36A, a display Part 38A is realized. Although only the configuration of the terminal 12A-1 is shown in FIG. 1, the other terminals 12A-2, 12A-3,...

  The user interface unit 32A inputs an operation event corresponding to the operation of the input device by the user. Examples of the operation event include a content acquisition request and a scroll request.

  The operation event filter unit 34A determines whether or not the operation event input by the user interface unit 32A is an operation event to be transmitted to the server 10A. That is, it is determined whether the process corresponding to the operation event is executed in the own terminal 12 or the server 10A.

  The event transmission unit 36A transmits the operation event determined to be transmitted to the server 10A by the operation event filter unit 34A to the server 10A.

  The display unit 38 </ b> A controls display on a display unit (display) provided in the terminal 12. When the terminal 12 uses the screen transfer service of the server 10A, the display unit 38A controls screen display based on the screen data received from the server 10A.

Next, the operation of the screen display system in this embodiment will be described.
In the image display system according to the present embodiment, for example, when the terminal 12 first accesses the server 10A via the network 14 in order to use the service of the server 10A, the server 10A displays the resolution of the screen displayed on the terminal 12. Is received from the terminal 12. The resolution data includes data indicating the vertical resolution (vertical resolution) and the horizontal resolution (horizontal resolution) of the screen.

FIG. 2 is a flowchart showing terminal processing of the terminal 12 in the present embodiment.
When there is a user operation, the terminal 12 inputs an operation event through the user interface unit 32A (step C1, Yes). For example, when an “operation event corresponding to a content acquisition request” is input, the operation event filter unit 34A executes an operation event filter process on the input operation event (step C2). That is, the operation event filter unit 34A determines whether or not the input operation event is an operation event to be transmitted to the server 10A.

  Here, when it is determined that the operation event is to be transmitted to the server 10A (step C3, Yes), the event transmission unit 36A transmits the operation event to the server 10A (step C4). On the other hand, when it is determined that the operation event is not to be transmitted to the server 10A (step C3, No), the terminal 12 executes processing corresponding to the operation event by the service program 30A (step C5). A processing example corresponding to an operation event executed in the terminal 12 will be described later.

  In the case of the “operation event corresponding to the content acquisition request”, the operation event filter unit 34A determines that it should be transmitted to the server 10A, and the event transmission unit 36A transmits it to the server 10A.

  When the “operation event corresponding to the content acquisition request” is received, the scheduler 22A of the server 10A instructs the screen data creation unit 24A to generate screen data for the content that is the target of the “content acquisition request”.

  The screen data creation unit 24A creates screen data in accordance with an instruction from the scheduler 22A. The screen data transmission control unit 26A transmits the screen data created by the screen data creation unit 24A to all terminals 12 that use the screen transfer service (share the screen). Upon receiving the screen data from the server 10A, the terminal 12 causes the display unit 38A to display a screen on the display according to the screen data.

  Next, for example, it is assumed that an “operation event corresponding to enlargement / reduction by the server” is input in the terminal 12 (share source terminal). The terminal 12 determines that this operation event should be transmitted to the server 10A, and transmits it by the event transmitter 36A.

  When an enlargement / reduction operation event is received, the scheduler 22A of the server 10A instructs the screen data creation unit 24A to generate screen data of screens to be shared in the plurality of terminals 12. The screen data creation unit 24A executes screen data creation processing in response to an instruction from the scheduler 22A. In the screen data creation process, the screen content of the sharing source terminal is scaled according to the scaling event, and the size of the scaled screen content is adjusted to match the screen resolution of the other sharing destination terminals. Created screen data. The screen data transmission control unit 26A transmits the screen data created by the screen data creation unit 24A to all the terminals 12 sharing the screen. Alternatively, as another embodiment, in the screen data creation process, the contents of the screen of the sharing source terminal are enlarged / reduced according to the operation event of enlargement / reduction, and then transmitted to all terminals 12 sharing the screen. A terminal that has received an enlarged / reduced screen can also create screen data whose size is adjusted according to the resolution of the terminal itself.

  For example, it is assumed that “an operation event corresponding to enlargement / reduction by the terminal” is input in the terminal 12 (share source terminal). The terminal 12 performs enlargement / reduction processing in the terminal in response to the operation event.

FIG. 3 is a flowchart showing screen data enlargement / reduction processing by the server 10A (screen data creation unit 24A) or the terminal 12A (display unit 38A) in the present embodiment.
The screen data creation unit 24A or the display unit 38A sets the magnification for adjusting the screen of the sharing source terminal in accordance with the resolution of the screen of the sharing destination terminal, and the screen resolution of each of the sharing source terminal and the sharing destination terminal. Calculate according to the following procedure.

  First, the screen data creation unit 24A or the display unit 38A displays “A = horizontal resolution of the sharing destination terminal / horizontal resolution of the sharing source terminal” and “B = vertical resolution of the sharing destination terminal / vertical resolution of the sharing source terminal”. Are calculated respectively (steps B1 and B2). That is, the first ratio A of the screen resolution in the vertical direction of each of the sharing destination terminal (first terminal) and the sharing source terminal (second terminal), and the sharing destination terminal (first terminal) and the sharing source terminal (second terminal) ) Of each of the horizontal screen resolutions is calculated.

  Here, if “A> B” (step B3, Yes), the screen data creation unit 24A adjusts (enlarges or reduces) the size of the screen data of the sharing source terminal by the magnification A (step B4). On the other hand, when “A> B” is not satisfied (step B3, No), the screen data creation unit 24A adjusts (enlarges or reduces) the size of the screen data of the sharing source terminal by the magnification B (step B5). That is, by adjusting the screen size based on the magnification A or B corresponding to the larger one of the first ratio A and the second ratio B, the screen of the sharing source terminal is The display width in one of the horizontal direction and the horizontal direction can be matched, and the screen can be displayed so as not to generate a blank space on the screen of the sharing destination terminal. Therefore, even if the screen resolution of the sharing source terminal and the screen resolution of the sharing destination terminal are different, the operability for the screen shared in the sharing source terminal is not impaired.

  In the above description, the case where the “operation event corresponding to enlargement / reduction by the server” is input is described. However, when the “operation event corresponding to enlargement / reduction by the terminal” is input by the user operation, In the terminal process shown in FIG. 2 (step C5), the terminal 12 executes the process according to the operation event as follows.

  The terminal 12 performs an enlargement / reduction process corresponding to the operation event on the image recorded on the recording medium (local) of the terminal 12 by the function realized by the service program 30A. The display unit 38A displays an image scaled according to the operation event on the screen. Note that the lower limit of the screen reduction magnification is set so that the display image does not become smaller than the screen size due to image reduction.

For example, the lower limit of the screen reduction magnification is calculated as follows.
Lower limit of screen reduction ratio = max (vertical resolution of terminal / vertical resolution of screen held in terminal, horizontal resolution of terminal / horizontal resolution of screen held in terminal)
These reduction processes are not limited to images that do not need to be reduced to match the screen size, such as when creating thumbnails on the server or client, and allow display images to be smaller than the screen size. That is, the screen is reduced at a magnification as required.

Next, a case where an operation event for a scroll operation is input on the terminal 12 will be described.
FIG. 4 is a flowchart showing scroll event processing by the server 10A in this embodiment, and FIG. 5 is a diagram showing a sequence of processing executed by the terminal 12 and the server 10A when an operation event for scroll operation is performed.

  In the screen sharing system according to the present embodiment, a scroll operation can be performed on a shared screen at both the sharing source terminal and the sharing destination terminal. Here, the terminal 12 that has been scrolled by the user is referred to as an operating terminal 12A, and the other terminals 12 that share the scrolled screen are referred to as browsing terminals 12B (12B1, 12B2,...). When displaying a screen that can be scrolled (for example, a browser screen), it is assumed that a screen larger than the screen necessary for display is held in advance in the terminal in order to perform the scrolling operation comfortably. .

  In the operation terminal 12A, it is assumed that an operation event of a scroll operation for scrolling the screen is input according to a user operation (S1 in FIG. 5). The operation terminal 12A determines that the operation event of the scroll operation should be transmitted to the server 10A by the operation event filtering process shown in FIG. 2 (S2), and the event transmission unit 36A transmits the operation event to the server 10A (S3).

  When the operation event of the scroll operation is received (step A1, Yes), the scheduler 22A of the server 10A notifies the scroll event by the screen data transmission control unit 26A (step A2) (S4). The screen data transmission control unit 26A asynchronously notifies the plurality of viewing terminals 12B1, 12B2,. In the notification of the scroll event, the absolute coordinates (coordinates in the content) of the scroll destination corresponding to the scroll operation are notified (step A2).

  Each of the plurality of browsing terminals 12B1, 12B2,... That has received the scroll event uses the screen previously held in the terminal based on the absolute coordinates of the scroll destination before receiving the screen data of the screen to be shared. Scroll (S5). At this time, the plurality of browsing terminals 12B1, 12B2,... Smoothly scroll to the absolute coordinates designated by the scroll event while using the screen transfer service (while sharing the screen). The screen is scrolled to the designated coordinates over a predetermined set time (Xmsec) (X is a set value).

  On the other hand, the scheduler 22A of the server 10A notifies the scroll event by the screen data transmission control unit 26A, and instructs the screen data creation unit 24A to generate screen data based on the scroll event. The screen data creation unit 24A creates a screen corresponding to the position of the scroll destination in response to an instruction from the scheduler 22A (step A3), and according to the screen resolution of the browsing terminals 12B1, 12B2,. Screen data is created (S6).

  The screen data transmission control unit 26A transmits the scrolled screen data created by the screen data creation unit 24A to all the browsing terminals 12B1, 12B2,... (S7). The display unit 38A of the browsing terminals 12B1, 12B2,... Displays the screen data received from the server 10A on the screen (S8).

  In the above-described scroll event processing, the server 10A generates a screen that is scrolled according to a scroll operation. For this reason, in FIG. 5, similarly to the browsing terminal 12B, the operation terminal 12A receives the scroll event from the server 10A and displays the screen based on the screen data received thereafter (S8). On the other hand, a scrolled screen may be generated on the operation terminal 12A. In this case, the server 10A receives the scrolled screen data from the operation terminal 12A together with the scroll operation operation event, and notifies the viewing terminals 12B1, 12B2,... Screen data creation processing is executed on the screen data of the screen to create screen data, and the screen data is transmitted to all browsing terminals 12B1, 12B2,.

  In this way, in the screen sharing system according to the present embodiment, the scroll event is notified from the server 10A to the viewing terminals 12B1, 12B2,... ,..., While scrolling the screen over a predetermined time (Xsec), screen data is created by screen data creation processing and transmitted to the browsing terminals 12B1, 12B2,. Therefore, it is possible to shorten the time from when the operation event of the scroll operation is transmitted from the operation terminal 12A to the server 12A until the screen after the viewing terminals 12B1, 12B2,. As a result, even in a system (for example, an online game system) that performs an input operation on the screen at each of the sharing source terminal and the sharing destination terminal, the shift in the timing of the screen display between the terminals is reduced and the operability is reduced. Can be suppressed.

Next, an example of another screen sharing system in the present embodiment will be described.
FIG. 6 shows an example of a screen sharing system that provides a content service that acquires content information from the content server 17 and shares a screen for displaying the content in a plurality of terminals 12B-1, 12B-2, 12B-3,. Indicates. In FIG. 6, an output function division server 10B is provided instead of the server 10A that provides the screen transfer service shown in FIG. The output function division server 10B implements the functions of, for example, the scheduler 22B, the screen data creation unit 24B, and the screen data transmission control unit 26B by executing a service program 20B for providing a content service by a processor. Note that functions having the same names as those in the configuration shown in FIG. 1 have substantially the same functions as the screen sharing system shown in FIG.

  The screen sharing system of FIG. 6 executes a program for browsing (browsing) content in the output function dividing server 10B and a plurality of terminals 12B-1, 12B-2, 12B-3,. The functions are divided into programs, and a plurality of terminals 12B-1, 12B-2, 12B-3,... Are operated in cooperation with the output function dividing server 10B. By linking a plurality of terminals 12B-1, 12B-2, 12B-3,..., A screen for displaying content and an operation event corresponding to a user operation can be shared.

  The output function division server 10B outputs a content acquisition request to the content server 17 connected via the network 16 in response to the content acquisition request from the terminals 12B-1, 12B-2, 12B-3,. The output function division server 10B acquires the content information (information necessary for outputting the screen) of the content output from the content server 17 in response to the content acquisition request. Based on the content information, the output function dividing server 10B generates screen data corresponding to operation events (enlargement / reduction, scrolling, etc.) received from the terminals 12B-1, 12B-2, 12B-3,. To the terminals 12B-1, 12B-2, 12B-3,. Note that generation of screen data corresponding to an operation event is executed in the same manner as described above, and detailed description thereof is omitted.

  FIG. 7 shows screen sharing that provides a Web browsing service that acquires Web content information from the Web server 18 and shares a screen for displaying the Web content in a plurality of terminals 12C-1, 12C-2, 12C-3,. An example of a system is shown. In FIG. 7, an output function dividing server 10C is provided instead of the server 10A that provides the screen transfer service shown in FIG. The output function division server 10C implements the functions of, for example, the scheduler 22C, the screen data creation unit 24C, and the screen data transmission control unit 26C by executing a service program 20C for providing Web content by a processor. Note that functions having the same names as those in the configuration shown in FIG. 1 have substantially the same functions as the screen sharing system shown in FIG.

  The screen sharing system of FIG. 7 executes a program for browsing (browsing) Web content in a program executed in the output function dividing server 10C and a plurality of terminals 12C-1, 12C-2, 12C-3,. Are divided into programs, and a plurality of terminals 12C-1, 12C-2, 12C-3,... Are operated in cooperation with the output function dividing server 10C. By linking a plurality of terminals 12C-1, 12C-2, 12C-3,..., It is possible to share a screen for displaying Web content and an operation event corresponding to a user operation.

  The output function division server 10C outputs a Web content acquisition request to the Web server 18 connected via the network 16 in response to a Web content browsing request from the terminals 12C-1, 12C-2, 12C-3,. To do. The output function division server 10C acquires the Web content information (information necessary for outputting the screen) of the Web content output from the Web server 18 in response to the Web content acquisition request. The output function division server 10B generates screen data according to operation events (enlargement / reduction, scrolling, etc.) received from the terminals 12C-1, 12C-2, 12C-3,... Based on the Web content information. And output to the terminals 12C-1, 12C-2, 12C-3,. Note that generation of screen data corresponding to an operation event is executed in the same manner as described above, and detailed description thereof is omitted.

Next, an application example of the screen sharing system using the server 10A (or the output function division servers 10B and 10C) in the present embodiment will be described.
FIG. 8 shows an example of a screen sharing system provided with a plurality of server units 101, 102, 103 corresponding to the server 10A (or output function division servers 10B, 10C).

  The integrated management unit 50 illustrated in FIG. 8 includes a plurality of server units 101, 102, and 103, a server management unit 58, and a shared cooperation unit 52.

  The server management unit 58 performs some kind of user authentication or terminal authentication, and manages the user and the plurality of server units 101, 102, 103 in association with each other.

  The sharing cooperation unit 52 manages the notification information of the sharing invitation notification and the shared trust notification from the user terminal, and individually sends the client programs 60D1 of the plurality of terminals 12D1, 12D2, and 12D3 to the server units 101, 102, and 103. , 60D2, 60D3. The client programs 60D1, 60D2, and 60D3 operate on OSs (operating systems) 62D1, 62D2, and 62D3 (for example, android (registered trademark)) installed in the respective terminals 12D1, 12D2, and 12D3.

The shared cooperation unit 52 includes a shared group management unit 54 and a server / client cooperation unit 56.
The shared group management unit 54 manages a plurality of users that can be selected as a sharing partner for each user registered in advance as a shared group. The sharing invitation user terminal that invites sharing acquires a sharing group from the integrated management unit 50, sets the sharing partner, sharing operation authority, and other related information, and notifies the server units 101, 102, and 103 of the sharing invitation request To do.

  The server / client cooperation unit 56 cooperates with the server management unit 58 and the client programs 60D1, 60D2, and 60D3 of the plurality of terminals 12D1, 12D2, and 12D3, and the server units 101, 102, and 103 and the plurality of terminals 12D1, 12D2, and 12D3. Manage linkages with.

Next, the sequence of the screen sharing system shown in FIG. 8 will be described.
When the user (a) using the terminal 12D2 increases the number of terminals sharing the screen, the sharing partner list is acquired from the sharing cooperation unit 52. The terminal 12D2 selects a sharing partner and a sharing authority from the acquired sharing partner list, and notifies the sharing cooperation unit 52 of a sharing invitation. At this time, the acquired shared partner list is displayed on the screen of the terminal 12D2. For example, “TV” indicating the terminal 12D1 and “I” indicating the terminal 12D3 are displayed. When the user (A) selects “TV”, the terminal 12D2 transmits to the sharing cooperation unit 52 a sharing invitation notification N1 that instructs sharing authority with the sharing partner.

  The sharing cooperation unit 52 acquires the browser process information of the terminal 12D2 from the server management unit 58. The browser process information is information on the terminal 12D2 using the server unit 101, and for example, ID = ID002 of the terminal 12D2.

  When the sharing cooperation unit 52 receives the sharing invitation notification N1, the sharing cooperation unit 52 associates the terminal 12D2 and the terminal 12D1 and registers them in the browser sharing cooperation DB.

  The sharing cooperation unit 52 sends a sharing request notification to the terminal 12D1. The share cooperation unit 52 waits for a share acceptance notification from the terminal 12D1 for a certain period. If there is no sharing acceptance notification for a certain period, it is determined that sharing is invalid, and the processing for the sharing invitation notification N1 is terminated.

  When the terminal 12D1 receives information related to the sharing request in response to a periodic inquiry to the integrated management unit 50 or a sharing request notification from the sharing cooperation unit 52, the terminal 12D1 confirms the sharing invitation user and the sharing authority, and accepts the sharing request / The refusal is set and the share cooperation unit 52 is notified of the share acceptance N2.

  The sharing cooperation unit 52 notifies the server management unit 58 of shared information. At this time, the server / client cooperation unit 56 specifies the server unit 101 used by the terminal 12D1 and notifies the server management unit 58 when receiving the shared entrustment notification N2. The server management unit 58 sets sharing authority for the server unit 102.

  The sharing cooperation unit 52 notifies the connection information of the server unit 102 of the terminal 12D2 to the terminal 12D1 that has accepted the sharing. The terminal 12D1 makes a shared connection to the server unit 102 used by the terminal 12D2 based on the notified connection information (server address, port number). Thereby, the connection destination by the terminal 12D1 is switched from the server unit 101 to the server unit 102 (N4).

  Note that the terminal 12D3 used by the user (I) can be switched from the server unit 103 to the server unit 102 in the same manner as described above (N5). In this way, the service provided by the server unit 102 can be shared by the terminals 12D1, 12D2, and 12D3. In this case, the terminal 12D2 can select the terminals 12D1 and 12D3 to end the sharing or change the authority. Further, the terminal 12D2 can select a shared commissioned user and individually terminate sharing, or collectively terminate sharing with all shared commissioned users. Further, when the terminal 12D2 finishes using the service of the server unit 102, the sharing of all the terminals 12D1 and 12D3 is ended.

  In this way, in a screen sharing system having a plurality of server units 101, 102, and 103, a plurality of terminals 12D1, 12D2, and 12D3 (client programs 60D1, 60D2, and 60D3) are sent to the individual server units 101, 102, and 103. ), And a plurality of terminals 12D1, 12D2, and 12D3 can share services provided by the individual server units 101, 102, and 103.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  10A ... Server for providing screen transfer service, 10B, 10C ... Output function division server, 12A ... Operation terminal, 22A ... Scheduler, 24A ... Screen data creation unit, 26A ... Screen data transmission control unit, 32A ... User interface unit, 34A ... an operation event filter part, 36A ... an event transmission part, 38A ... a display part.

Claims (8)

A server that provides a service for transmitting screen data to be displayed on each screen of the first terminal and the second terminal to the first terminal and the second terminal connected via a network,
An operation event receiving means for receiving an operation event for changing a screen from the first terminal;
An operation event transmitting means for transmitting the operation event to the second terminal in response to the operation event;
In response to the operation event, a first magnification based on a first ratio of screen resolution in the vertical direction of each of the first terminal and the second terminal, and each of the first terminal and the second terminal. Based on one of the second magnifications based on the second ratio of the screen resolution in the horizontal direction, the size of the first screen data displayed on the screen of the first terminal is changed to change the second screen data Screen data creation means to create;
Screen data transmission control means for transmitting the second screen data to the second terminal while the second terminal is executing a process related to the operation event after transmitting the operation event to the second terminal; Server with.   The screen data creation unit creates the second screen data based on the first magnification or the second magnification corresponding to the larger one of the first ratio and the second ratio. server. When the operation event reception unit receives an operation event corresponding to screen scrolling, the operation event transmission unit causes the second terminal to transmit the operation event for notifying the scroll position, and then the second terminal 2. The server according to claim 1, wherein the second screen data is created by the screen data creation means while the screen scroll is executed based on the image data held in the terminal . When the operation event receiving unit receives an operation event corresponding to the content acquisition request from the first terminal, the content acquisition unit further acquires content corresponding to the content acquisition request,
The server according to claim 1, wherein the screen data creating unit creates the second screen data of the content. A screen executed by a server that provides a service for transmitting screen data to be displayed on each screen of the first terminal and the second terminal to the first terminal and the second terminal connected via a network Display method,
An operation event receiving step of receiving an operation event for changing a screen from the first terminal;
An operation event transmission step of transmitting the operation event to the second terminal in response to the operation event;
In response to the operation event, a first magnification based on a first ratio of screen resolution in the vertical direction of each of the first terminal and the second terminal, and each of the first terminal and the second terminal. Based on one of the second magnifications based on the second ratio of the screen resolution in the horizontal direction, the size of the first screen data displayed on the screen of the first terminal is changed to change the second screen data A screen data creation step to be created;
A screen data transmission control step of transmitting the second screen data to the second terminal while the second terminal is executing a process related to the operation event after transmitting the operation event to the second terminal; A screen display method. An operation event receiving means for receiving an operation event in another terminal;
Processing means for executing processing related to the operation event in response to reception of the operation event;
Receiving means for receiving first screen data generated according to the resolution of the screen of the other terminal ;
While executing the process related to the operation event, a first magnification based on a first ratio of screen resolutions in the vertical direction of the first screen data and the screen of the terminal , and the first screen The second screen data is created by changing the size of the first screen data based on one of the second magnifications based on the second ratio of the horizontal resolution of the data and the terminal itself. Screen data creation means;
A terminal having screen data display means for displaying the second screen data after processing related to the operation event . The operation event receiving means receives a scroll position corresponding to a screen scroll operation event in the other terminal ,
The screen data display means, the terminal according to claim 6, wherein the displaying the second screen data after scrolling the screen according to the scroll position. A screen display method in a system in which a first terminal and a second terminal are connected via a network,
An operation event transmission step of receiving an operation event for changing a screen from the first terminal and transmitting the operation event to the second terminal;
A processing step of executing processing according to the operation event in the second terminal;
Receiving the first screen data generated according to the screen resolution of the first terminal at the second terminal;
In the second terminal, while executing the process related to the operation event, a first ratio based on the first ratio of the vertical screen resolutions of the first screen data and the screen of the second terminal. The size of the first screen data is determined based on one magnification and a second magnification based on a second ratio of the horizontal screen resolution of each of the first screen data and the second terminal. A screen data creation step for creating the second screen data by changing ;
And a display step of displaying the second screen data after processing related to the operation event .

Images