JP5003561B2 - Client device, server device, client control program, and server control program - Google Patents

Description

The present invention relates to a client device, a server device , a client control program, and a server control program for browsing screen data downloaded from a server device, for example, in a thin client terminal device.

  Camera-equipped mobile terminals (telephones, digital cameras, etc.) are equipped with a display screen for displaying captured images, and can be enlarged / reduced / scrolled / turned through simple operations. For this reason, in addition to the usual use of the camera, such as taking commemorative photos, taking pictures with the camera instead of taking notes of the contents of the timetable, and viewing and viewing the necessary images later when necessary Usage is generalized.

  In addition to the shooting function, there are also portable terminals that are equipped with application programs such as a document viewer and a Web browser, and are capable of browsing data other than shot images.

  And since recent mobile terminals store various personal information such as address books and emails in addition to captured images, advanced security functions from password protection to biometric authentication to prevent data leakage are implemented. And by using these security functions, it is also suitable for applications such as carrying data and browsing it when you like.

  However, even with such a multi-functional camera-equipped mobile terminal, unlike a personal computer or the like, the types of application programs installed other than the shooting function are limited, and the function is limited due to CPU performance and memory capacity restrictions. There are many restrictions, and not all data can be browsed.

  On the other hand, a server-based computing system sends input keys, touch panel coordinates, and the like from a thin client terminal having a display device and an input device such as a simple key and a touch panel to the server device. This is a mechanism in which all processing is performed by an application program and the result is sent to a client terminal and displayed on a screen. For this reason, even a thin client terminal has a great advantage that various application programs not installed in the terminal can be executed.

  Therefore, it is conceivable that the portable terminal can be used as a client terminal on the server-based computing system. However, in order to execute an application program on the system, the portable terminal must be connected to a server device. If the connection is not possible, the user cannot browse the desired data.

Note that an IP communication system using a thin client (TC) system in which video telephone communication is realized via a server device by a thin client terminal connected to a camera is considered (for example, see Patent Document 1).
JP 2006-254411 A

  In the conventional portable terminal, not only the terminal itself but also the client terminal on the server-based computing system can be used as a client terminal, and necessary and sufficient data is browsed if it is not connected to the server apparatus on the system. Can not.

The present invention has been made in view of such problems, in a thin client terminal, the image data downloaded from the server device and stored in a sufficient image quality, so that it becomes possible to view offline For the purpose.

Claim 1 is a client that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event A display unit, application information transmission means for transmitting information of an application program held by the client device itself to the server device, and the screen data displayed on the display unit in response to a user operation. Capture instruction means for transmitting a capture instruction for the screen data to the server apparatus, and receiving processing result data of the application program transmitted from the server apparatus in response to the capture instruction by the capture instruction means. Store server processing data storage Comprising a stage, and a capture data display control means for displaying on said display unit the stored data by the application program corresponding to the data by the server processing data storing means, from said server device by said server process data storage means The data of the processing result of the application program in the server device received and stored is received as data of a file opened by the client device based on the information of the application program held by the client device itself transmitted by the application information transmitting means. It is characterized by being.

Claim 2 is a client that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event A display unit, a screen size transmission unit that transmits the screen size of the display unit to the server device, and the screen data in response to a user operation in a state where the screen data is displayed on the display unit. Capture instruction means for transmitting a capture instruction to the server apparatus, and server processing for receiving and storing data of a processing result of the application program transmitted from the server apparatus in response to the capture instruction by the capture instruction means Data storage means and server processing data storage means Includes a capture data display control means for displaying on the display unit by the憶data application program corresponding to the data, and at the server device to be stored is received from said server device by said server process data storage means The processing result data of the application program is received as image data divided into a plurality of sheets corresponding to the screen size of the display unit transmitted by the screen size transmitting means.

Claim 3 is a client that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event A display unit, capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit, and the capture instruction Server processing data storage means for receiving and storing processing result data of the application program transmitted from the server device in response to a capture instruction by the means, and data stored by the server processing data storage means By application program corresponding to And capture data display control means for displaying on the serial display unit, the capturing instruction means screen capturing instruction for receiving capturing instruction screen data displayed on the display unit transmitted from the server device in response to the capture instruction from receiving means, if the capturing instruction is received by the screen capture instruction receiving means is characterized by comprising: a screen data storing means for storing the screen data displayed on the display unit.

[Claim 5] A server device for transmitting screen data generated in accordance with processing of an application program that operates in response to an input event from a client device connected via a network to the client device, wherein the screen data is transmitted to the client device. Capture instruction receiving means for receiving the capture instruction transmitted from the client apparatus for the screen data, and transmitting the data of the processing result of the application program to the client apparatus in response to reception of the capture instruction by the capture instruction receiving means a processed data transmitting means for, and the application information receiving means for receiving information of application programs included in the transmitted the client device from the client device, the click received by the application information receiving means Based on the information of the application program Ianto device has, and a determination means for opening to determine whether the data whether the data of the processing result of the application program is opened in the client device in the server device, the processing data transmission means In response to reception of the capture instruction by the capture instruction receiving means, when the opening determining means determines that the data is to be opened by the client apparatus, the processing result data of the application program in the server apparatus is converted to file data. Is transmitted to the client device .

Claim 8 is a server device that transmits screen data generated in accordance with processing of an application program that operates in response to an input event from a client device connected via a network to the client device, and transmits the screen data to the client device Capture instruction receiving means for receiving the capture instruction transmitted from the client apparatus for the screen data, and transmitting the data of the processing result of the application program to the client apparatus in response to reception of the capture instruction by the capture instruction receiving means Processing data transmitting means, and application information receiving means for receiving information of an application program held by the client device transmitted from the client device, wherein the processing data transmitting means Based on the information of the application program that the client device has received by broadcast receiving means, transmits the data of the processing result of the application program in the server device as a data file opened by the client device is characterized in that.

The client according to claim 9 transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event. A client control program for controlling a computer of an apparatus, the application information transmitting means for transmitting information of an application program owned by the client apparatus itself to the server apparatus, and the screen data being displayed on a display unit A capture instruction means for transmitting a capture instruction for the screen data to the server apparatus in response to a user operation, and the application program transmitted from the server apparatus in response to the capture instruction by the capture instruction means. Server processing data storage means for receiving the processing result data of the above and storing it in the storage section, and capture data display control for causing the display section to display the data stored in the server processing data storage means by an application program corresponding to the data The data of the processing result of the application program in the server device received and stored from the server device by the server processing data storage unit is stored in the client device itself transmitted by the application information transmitting unit. It is characterized in that it is received as file data that can be opened by the client device based on the information of the application program it has.
10. A client that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event A client control program for controlling a computer of a device, wherein the computer is a screen size transmitting means for transmitting a screen size of a display unit to the server device, and a user is displayed in a state where the screen data is displayed on the display unit. Capture instruction means for transmitting a capture instruction for the screen data to the server apparatus in response to an operation, and receiving processing result data of the application program transmitted from the server apparatus in response to the capture instruction by the capture instruction means Server Functioning as a captured data display control means for causing the display unit to display data stored in the server processing data storage means by an application program corresponding to the data, and the server processing data storage means The processing result data of the application program in the server device received from the device and stored as image data divided into a plurality of sheets corresponding to the screen size of the display unit transmitted by the screen size transmission means It is characterized by being received.
11. A client that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to processing of an application program of the server device in response to the input event A capture instruction means for transmitting a capture instruction for the screen data to the server apparatus in response to a user operation in a state where the screen data is displayed on the display unit, and responding to the capture instruction by the capture instruction means Then, server processing data storage means for receiving and storing the processing result data of the application program transmitted from the server device, and the data stored by the server processing data storage means by the application program corresponding to the data Display on display Capture data display control means, screen capture instruction receiving means for receiving a screen data capture instruction displayed on the display unit transmitted from the server device in response to a capture instruction by the capture instruction means, and this screen capture When a capture instruction is received by the instruction receiving unit, the screen receiving unit functions as a screen data storage unit that stores screen data displayed on the display unit.

12. A server control for controlling a computer of a server device that transmits screen data generated in accordance with processing of an application program that operates in response to an input event from a client device connected via a network to the client device. A capture instruction receiving means for receiving a capture instruction transmitted from the client apparatus for the screen data transmitted to the client apparatus according to reception of a capture instruction by the capture instruction receiving means. Processing data transmission means for transmitting processing result data of the application program to the client device, and receives information on the application program of the client device transmitted from the client device Functioning as application information receiving means, wherein the processing data transmitting means receives data of the processing result of the application program in the server device based on the information of the application program of the client device received by the application information receiving means. It is characterized in that it is transmitted as file data that can be opened by the client device .

According to the present invention, in a thin client terminal, the image data downloaded from the server device and stored in a sufficient image quality, to be capable of viewing offline ing.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is an image diagram showing a configuration of a server-based computing system (SBC) according to an embodiment of the present invention.

  This SBC system includes a server device 10 connected on a communication network N composed of a LAN (Local Area Network) or a WAN (Wide Area Network), and a camera-equipped mobile terminal 20 as a client device (Thin client). .

  Note that the camera-equipped mobile terminal 20 used in the present embodiment may be, for example, a mobile phone or a digital camera having a communication function, and includes a shutter key 24S for photographing.

  The server device 10 has various application programs such as a document creation processing program, a spreadsheet processing program, a mail processing program, an Internet connection processing program, a Web browser program, and the like, and a camera-equipped mobile phone connected to the server device 10. It is activated in response to an operation input (input event) signal from the terminal 20,.

  In this server device 10, the display data of the execution result generated along with the execution of the application program activated in response to the operation input signal from the camera-equipped mobile terminal 20,... Has the display screen size of the mobile terminal 20. After being reduced together, it is transmitted (transferred) to the mobile terminal 20 that is the access source.

  In the camera-equipped mobile terminals 20,..., The display screen data transferred from the server device 10 is expanded in the frame buffer (display content storage unit 22 b: see FIG. 4) and displayed on the LCD display device 25.

  That is, each camera-equipped mobile terminal (thin client device) 20 in the SBC system has an input function, a shooting function, an LCD display, and the like according to user operations such as a keyboard (input device) 24 and a digital camera (shooting device) 26. The camera-equipped mobile terminal 20 has only limited functions in advance, such as an output function to the device 25, and does not have most of various application functions that the server device 10 has.

  FIG. 2 is a block diagram showing a circuit configuration of the server device 10 in the SBC system.

  The server device 10 includes a control device (CPU) 11 as a computer. The control device 11 includes a storage device 12 using a hard disk (HDD) or flash ROM, a storage medium such as a magnetic disk, an optical disk, and a memory card. The target external storage device 13 is connected.

  In addition, the control device (CPU) 11 communicates with an input device 14 such as a keyboard and a mouse, a display device 15 including an LCD (Liquid Crystal Display), and the mobile terminal (thin client device) 20. A transmission / reception device 16 or the like is connected.

  The control device 11 controls the operation of each part of the circuit in accordance with a system program and various application programs stored in advance in the storage device 12. The control device 11 receives the key input signal from the input device 14 and the transmission / reception device 16. The various programs are activated and executed in response to a processing command (input event) signal corresponding to a user operation from the mobile terminal 20 to be executed.

  In this server device 10, various data generated in accordance with an application program activated / executed in response to an input event signal from the mobile terminal 20 is stored in the storage device 12 in association with the user ID, for example. Or stored in a storage medium of the external storage device 13. The display data for the mobile terminal 20 is reduced in accordance with the display screen size of the mobile terminal 20 and then transferred from the transmission / reception device 16 to the mobile terminal 20 for display output.

  The storage device 12 includes an authentication information storage unit 12a, an opening information storage unit 12b, an application storage unit 12c, an application execution environment storage unit 12d, a terminal image pixel number storage unit 12e, a terminal shootable image number storage unit 12f, and terminal opening information. A storage unit 12g, a data storage unit 12h, an application execution result storage unit 12i, a transmission screen data storage unit 12j, and the like are provided.

  FIG. 3 is a diagram illustrating an example of data stored in the application storage unit 12c, the opened information storage unit 12b, and the data storage unit 12h included in the storage device 12 of the server device 10.

  The authentication information storage unit 12a stores a terminal user name and password for authenticating connection with the portable terminal (thin client device) 20.

  In the information storage unit 12b to be opened (see FIG. 3B), information on what kind of file can be opened by the application program of the server device 10 itself includes the application name 12b1 and the file format 12b2. Stored by combination.

  The application storage unit 12c (see FIG. 3A) stores an application program that runs on the server device 10.

  In the application execution environment storage unit 12d, work areas 12d1, 12d2,... For each terminal (user) for executing an application program corresponding to an input event from the portable terminal 20 are secured.

  In the terminal image pixel number storage unit 12e, the display pixel number (display screen size H × W) of the display device 25 that displays an image on the portable terminal 20 is acquired from the portable terminal 20 and stored.

  The terminal shootable number storage unit 12f stores the current number of shootable (storable) images according to the remaining data storage capacity in the portable terminal 20 and the number of display pixels.

  In the terminal opening information storage unit 12g, information about what file the portable terminal 20 opens is acquired from the portable terminal 20 and stored as a combination of the application name and the file format, for example.

  In the data storage unit 12h (see FIG. 3C), various files generated in accordance with the operations of various application programs stored in the application storage unit 12c are stored with their file names 12h1 and file formats ( The extension is stored in combination with 12h2.

  The application execution result storage unit 12 i stores display screen data generated in accordance with the desktop display screen size of the server device 10 by executing an application program according to an input event from the mobile terminal 20.

  The transmission screen data storage unit 12j stores the full-size display screen data stored in the application execution result storage unit 12i in the display screen size of the portable terminal 20 stored in the terminal image pixel number storage unit 12e. The display screen data for transfer reduced in combination is stored.

  That is, the server device 20 reduces the full-size image data for server display generated by executing an application program in response to an input event from the mobile terminal (client device) 20 to the display screen size of the terminal device 20. The terminal device 20 has a function of transmitting and displaying.

  The server device 20 is generated by the currently executing application program and stored in the application execution result storage unit 12i when a capture instruction associated with the operation input of the shutter key [S] 24s is received from the terminal device 20. Based on the information stored in the terminal opening information storage unit 12g (see FIG. 3B), it is determined whether or not the displayed display data file is a file that can be opened by the application program of the terminal device 20. Has a function to judge.

  If the server device 20 determines that the file can be opened by the application program of the terminal device 20, the server device 20 directly transmits the file data to the portable terminal 20 and determines that the file cannot be opened. In this case, when the image data of the file is divided according to the display screen size of the mobile terminal 20 stored in the terminal image pixel number storage unit 12e, the image can be captured stored in the terminal shootable number storage unit 12f. It has a function of determining whether or not it falls within the number. If it is determined that it fits, the image data of the file at the time of the capture instruction is transmitted to the mobile terminal 20 as image data divided by the display screen size of the mobile terminal 20, and if it does not fit If it is determined, it has a function of transmitting only a screen capture instruction for causing the terminal 20 to record the image data of the display screen data displayed on the portable terminal 20 as it is.

  FIG. 4 is a block diagram showing a circuit configuration of the camera-equipped mobile terminal (client device) 20 in the SBC system.

  The camera-equipped mobile terminal (client device) 20 includes a control unit (CPU) 21 as a computer. The control unit (CPU) 21 targets a storage device 22 including a flash ROM, a storage medium such as a memory card, and the like. The external storage device 23, the input device 24 such as a keyboard provided with the shutter key [S] 24S, and the display device 25 including an LCD are connected.

  The control unit (CPU) 21 is connected to a photographing device 26 for photographing a digital image in conjunction with an operation input of the shutter key [S] 24S, a transmission / reception device 27 for communicating with the server device 10, and the like. The

  The control device (CPU) 21 controls the operation of each part of the circuit in accordance with a system program stored in advance in the storage device 22 or an application program in accordance with a user operation. The program is activated and executed in accordance with an input signal, an application response signal from the server device 10 received via the transmission / reception device 27, display screen data, and the like.

  In the portable terminal (client device) 20, various data generated by executing the application program in the server device 10 is received as display screen data reduced and transferred according to the display screen size of the portable terminal 20. And is written in the display content storage unit 22b in the storage device 22 and displayed on the display device 25.

  The storage device 22 includes an application storage unit 22a, a display content storage unit 22b, a data storage unit 22c, an open information storage unit 22d, and the like.

  FIG. 5 is a diagram illustrating an example of data stored in the application storage unit 22a, the opened information storage unit 22d, and the data storage unit 22c provided in the storage device 22 of the portable terminal (client device) 20.

  The application storage unit 22a (see FIG. 5A) stores an application program that runs on the portable terminal (thin client device) 20.

  The display content storage unit 22b stores display screen data to be displayed on the display device 25, and functions as a frame buffer.

  The data storage unit 22c (see FIGS. 5C1 to 5C3) includes various files generated according to the operations of various application programs stored in the application storage unit 22c, and the server device 10. Various files generated or received and obtained by the application program or image data for display are stored in combination with the file (image data) name 22c1 and the file (data) format (extension) 22c2.

  In the information storage unit 22d to be opened (see FIG. 5B), information on what kind of file can be opened by the application program of the mobile terminal (client device) 20 itself includes the application name 22d1 and the file. Stored in combination with format 22d2.

  That is, the mobile terminal (client device) 20 first has a display screen size (number of terminal image pixels) of the mobile terminal 20 and a remaining storage capacity of the data storage unit 22c in connection with the connection and authentication with the server device 10. The number of storable images according to the information and the file information to be opened stored in the opening information storage unit 22d are transmitted to the server device 10 and then generated and transferred by the server device 10 in response to an event input accompanying a user operation. The display screen data thus stored is stored in the display content storage unit 22b and displayed.

  Then, the mobile terminal (client device) 20 responds to the operation input of the shutter key [S] 24S in the input device 24 and file data corresponding to the current display screen data transferred from the server device 10 (FIG. 5 ( C2) “capture file 1: html”), image data obtained by dividing the image data of the file (see “capture division n: jpg” in FIG. 5 (C3)), or display screen data currently being displayed. It has a function to save as it is.

  Next, a display data transfer / save function according to a capture instruction from the mobile terminal (thin client device) 20 in the server-based computing system having the above-described configuration will be described.

  FIG. 6 is a diagram showing a processing sequence between the mobile terminal (thin client device) 20 and the server device 10 in accordance with the operation of the server-based computing system.

  FIG. 7 is a flowchart showing processing on the mobile terminal (thin client device) 20 side in accordance with the operation of the server-based computing system.

  FIG. 8 is a flowchart showing processing on the server device 10 side in accordance with the operation of the server-based computing system.

  Note that (An) and (Bn) added to the step code Sn in each sequence in FIG. 6 are the codes of each processing step in the mobile terminal (thin client device) 20 in FIG. 7 and the server apparatus 10 in FIG. It is a code of each processing step.

  In portable terminal (client device) 20, when a user ID and password are input in response to a user operation to connect to server device 10 (step A1 [S1]), the user ID and password input by the user are It is transmitted to the server device 10 (step A3).

  In the server device 10, when the user ID and password transmitted from the mobile terminal 20 are received, the received user ID and password are verified against the information stored in the authentication information storage unit 12a. (Step B1 [S2]).

  Here, when it is determined that the authentication is OK and the signal of the authentication OK is transmitted to the mobile terminal 20 (step B2 (Yes)), the display screen size transmitted from the mobile terminal 20 in response to this is displayed. The corresponding pixel number information, the number of shootable images, and the file application information to be opened read from the opening information storage unit 22d (see FIG. 5B) are received, and the terminal image pixel number storage unit 12e and the terminal shooting are respectively received. It is stored in the possible number storage unit 12f and the terminal opening information storage unit 12g (step B3).

  Then, in the server device 10, a work area serving as the application execution environment 12d1 corresponding to the event input from the portable terminal 20 established this time is generated in the application execution environment storage unit 12d (step B4 [S3]). .

  At this time, the display screen data generated in accordance with the display screen size of the server device 10 is temporarily stored in the application execution result storage unit 12i and then stored in the terminal image pixel number storage unit 12e. Are reduced in accordance with the display screen size, stored in the transmission screen data storage unit 12j, and transmitted to the portable terminal 20 (steps B5 to B8).

  When the mobile terminal 20 receives the display screen data (initial screen) transmitted from the server device 10 (step A4 → A5 (Yes)), it is stored in the display content storage unit 22b and displayed on the display device 25. (Step A6 [S4]).

  When a key event corresponding to a user operation is input from the input device 24 based on the display screen data (initial screen) displayed on the display device 25 (step A1 [S5]), the key input event is stored in the server. It is transmitted to the device 10 (step A3).

  Then, in the server device 10, application processing corresponding to the key input event from the mobile terminal 20 is executed on the work area of the application execution environment 12 d 1, and display screen data corresponding to the application processing is generated to The result is temporarily stored in the execution result storage unit 12i (steps B5 to B7 [S6]). And the display screen data memorize | stored in this application execution result memory | storage part 12i are reduced according to the display screen size of the portable terminal 20 memorize | stored in the terminal image pixel number memory | storage part 12e similarly to the above, and are transmitted to the said portable terminal 20 (Step B8).

  Then, in the portable terminal 20, display screen data generated and transmitted by the server device 10 in response to the key event input by the user is received, stored in the display content storage unit 22b, and displayed on the display device 25. (Steps A4 to A6 [S7]).

  In this way, the application program of the server device 10 can be executed on the camera-equipped mobile terminal (thin client device) 20.

  Now, since the display screen data displayed on the display device 25 of the portable terminal 20 is not displayed when the connection with the server device 10 is terminated, the user takes a picture to save the display screen data. When the shutter key [S] 24S on the input device 24 is pressed in the same way as when taking a picture with the device 26, a capture instruction is transmitted from the portable terminal 20 to the server device 10 (step A2 → A7 [S8). ]).

  When the server device 10 receives the capture instruction transmitted from the mobile terminal 20 (step B6 (Yes)), the capture processing described below is executed (steps B9 to B13 [S9]).

  That is, in the server device 10, in response to an input event from the portable terminal 20, for example, a web browser program stored in the application storage unit 12c (see FIG. 3A) is executed, and the data storage unit 12h (FIG. 3 (C)), when the “file 1 (html)” is opened, information on the file opened on the portable terminal 20 side stored in the terminal opening information storage unit 12g “Web browser” If it is determined that the file can be opened based on (html, txt) ”(see FIG. 5B) (step B9 (Yes)), the file is stored in the data storage unit 12h (see FIG. 3C). The data of “file 1 (html)” is read as it is and transmitted to the portable terminal 20 as “open file data” (steps). 10).

  Then, the portable terminal 20 receives the data of the “file 1 (html)” transmitted as “open file data” from the server device 10, and receives the “capture file 1 (html)” (FIG. 5) in the data storage unit 22c. (See (C2)) (steps A8 to A10 [S10]).

  The file data “capture file 1 (html)” stored in the data storage section 22c is stored in the information storage section 22d (see FIG. 5B) of the open file application information “Web browser (html, txt) ”can be directly opened by the Web browser stored in the application storage unit 22a and browsed with high-quality images (steps A13 and A14 [S11]).

  Further, in the server device 10, when the application C stored in, for example, the application storage unit 12 c (see FIG. 3A) is executed in response to an input event from the mobile terminal 20, information on opening the terminal When it is determined that the file is not a file to be opened based on the information on the file application that can be opened on the mobile terminal 20 side (see FIG. 5B) stored in the storage unit 12g (step B9 (No)), Processing is performed.

  In other words, when the full-size display screen data for server display stored in the application execution result storage unit 12i is targeted according to the display screen size of the mobile terminal 20 stored in the terminal image pixel number storage unit 12e. Then, it is determined whether or not the divided number falls within the remaining number of shootable images stored in the terminal shootable number storage unit 12f (whether or not division is possible) (step B11).

  Here, the full-size display screen data generated by the application C stored in the application execution result storage unit 12i is divided according to the display screen size of the mobile terminal 20 stored in the terminal image pixel number storage unit 12e. When the number of divisions is, for example, four and is determined to be within the remaining number of shootable images stored in the terminal shootable number storage unit 12f, the division is determined to be possible (step B11 (Yes)). The full-size display screen data stored in the application execution result storage unit 12i is divided into four pieces, and the captured divided image data “divided 1 (jpg)” “divided 2 (jpg)” “divided 3 (jpg) ) "" Division 4 (jpg) "is transmitted to the portable terminal 20 (step B12).

  Then, the terminal device 20 receives the capture division data (image data obtained by dividing the full-size display screen data into four) transmitted from the server device 10 and receives “capture division 1 (jpg)”, “ It is stored as “capture division 2 (jpg)”, “capture division 3 (jpg)”, and “capture division 4 (jpg)” (see FIG. 5 (C3)) (step A9 → A11 [S10]).

  The capture division data “capture division 1 (jpg)”, “capture division 2 (jpg)”, “capture division 3 (jpg)”, and “capture division 4 (jpg)” stored in the data storage unit 22c are opened information storage units. Based on the information “image viewer (jpg)” of the file application to be opened stored in 22d (see FIG. 5B), it is opened by the image viewer stored in the application storage unit 22a and divided as full size data. It is possible to browse with high quality images (steps A13, A14 [S11]).

  On the other hand, the full size display screen data generated by the application C stored in the application execution result storage unit 12i is divided according to the display screen size of the mobile terminal 20 stored in the terminal image pixel number storage unit 12e. If it is determined that the number of divisions does not fall within the remaining number of shootable images stored in the terminal shootable number storage unit 12f, and it is determined that division is not possible (step B11 (No)), the mobile phone A screen capture instruction for saving the image data of the display screen currently displayed on the terminal 20 is transmitted to the mobile terminal 20 (step B13).

  In the terminal device 20, when the “screen capture instruction” transmitted from the server device 10 is received (step A8 (Yes)), the currently displayed image data stored in the display content storage unit 22b remains as it is. For example, it is stored in the data storage unit 22c as “capture image (jpg)” (step A12 [S10]).

  The screen capture data “capture image (jpg)” stored in the data storage section 22c is stored in the information storage section 22d (see FIG. 5B), the file application information “image viewer (jpg)” to be opened. Can be opened by the image viewer stored in the application storage unit 22a and viewed as it is (steps A13, A14 [S11]).

  Therefore, according to the transfer / storing function of the application generation data corresponding to the capture instruction accompanying the shutter operation from the mobile terminal (thin client device) 20 in the server-based computing system having the above configuration, the input from the mobile terminal 20 When the display screen data generated and transmitted by the server device 10 in response to an event is received and displayed on the mobile terminal 20 and the shutter key 24S is operated in response to a user operation, the server device 10 An instruction to capture the generated display screen data is transmitted to the server device 10. Then, in the server device 10, it is determined whether or not the display screen data file generated and transmitted by the currently activated application program is a file that can be opened by the application program of the portable terminal 10. If it is determined, the data of the file is transmitted to the portable terminal 20 and stored.

  When it is determined that the file cannot be opened by the application program of the mobile terminal 10, the full-size display screen data generated according to the display screen size of the server device 10 is displayed on the mobile terminal 20. The image data is divided into a plurality of parts corresponding to the screen size, and the divided image data is transmitted to the portable terminal 20 and stored.

  Further, in the server device 10, when it is determined that the number of divisions when the full-size display screen data is divided into a plurality of display screen sizes of the mobile terminal 20 exceeds the number of shootable images of the mobile terminal 20. The screen capture instruction is transmitted to the portable terminal 20, and the image data of the display screen data being displayed on the terminal 20 is stored as it is.

  Thereby, the camera-equipped mobile terminal 20 can not only save the display screen data generated and received and displayed by the application program of the server device 10 by the shutter operation in the same manner as taking a picture, but also display the display screen data. If the file is opened by the application program on the terminal 20 side, it can be acquired and stored as the data of the file itself. Since it can be acquired and stored as a plurality of divided image data, various data generated and acquired by the server device 10 can be viewed as high-quality image data as much as possible even when the server device 10 is offline. It becomes like this.

  It should be noted that the mobile terminal (thin client device) 20 shown in the flowchart of FIG. 7 according to each processing method by the server-based computing system described in the above embodiment, that is, the processing sequence of the entire system in FIG. As a program that can be executed by a computer, each of the methods such as terminal processing by the server and server processing by the server device 10 shown in the flowchart of FIG. 8 can be executed as a memory card (ROM card, RAM card, etc.) , Hard disk, etc.), optical disc (CD-ROM, DVD, etc.), semiconductor memory, etc., can be stored in a storage medium and distributed. Then, the portable terminal (thin client device) 20 or the computer (control unit 21 (11)) of the server device 10 stores the program stored in the storage medium of the external storage device 23 (13) in the storage device 22 (12). By reading and controlling the operation by the read program, the application generation data transfer / storing function according to the capture instruction accompanying the shutter operation described in the above embodiment is realized, and the same processing by the above-described method is performed. Can be executed.

  Further, program data for realizing each of the above methods can be transmitted on the communication network (N) in the form of a program code, and from a computer device (program server) connected to the communication network (N). The program data can be fetched and stored in the storage device 22 (12), and an application generation data transfer / save function corresponding to the capture instruction accompanying the shutter operation can be realized.

  Note that the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment or some constituent requirements are combined in different forms, the problems described in the column of the problem to be solved by the invention are not solved. When the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

1 is an image diagram showing a configuration of a server-based computing system (SBC: Server Based Computing system) according to an embodiment of the present invention. The block diagram which shows the circuit structure of the server apparatus 10 in the said SBC system. The figure which shows an example of the data memorize | stored in the application memory | storage part 12c, the information storage part 12b to open, and the data memory | storage part 12h with which the memory | storage device 12 of the said server apparatus 10 was equipped. The block diagram which shows the circuit structure of the portable terminal (client apparatus) 20 with a camera in the said SBC system. The figure which shows an example of the data memorize | stored in the application memory | storage part 22a with which the memory | storage device 22 of the said portable terminal (client apparatus) 20 was equipped, the information storage part 22d opened, and the data memory | storage part 22c. The figure which shows the process sequence between the portable terminal (thin client apparatus) 20 and the server apparatus 10 accompanying operation | movement of the said server base computing system. The flowchart which shows the process by the side of the portable terminal (thin client apparatus) 20 accompanying operation | movement of the said server base computing system. The flowchart which shows the process by the side of the server apparatus 10 accompanying operation | movement of the said server base computing system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Server apparatus 11, 21 ... Control part (CPU)
DESCRIPTION OF SYMBOLS 12, 22 ... Memory | storage device 12a ... Authentication information memory | storage part 12b ... (Server) Open information memory | storage part 12c ... (Server) Application memory | storage part 12d ... Application execution environment memory | storage part 12e ... Terminal image pixel number memory | storage part 12f ... Number of terminal imaging | photography possible number Storage unit 12g ... Terminal opening information storage unit 12h ... (Server) Data storage unit 12i ... Application execution result storage unit 12j ... Transmission screen data storage unit 22a ... (Terminal) Application storage unit 22b ... Display content storage unit 22c ... (Terminal) Data storage unit 22d (terminal) Information storage unit 13, 23 ... External storage device 14, 24 ... Input device 24S ... Shutter key 15, 25 ... Display device 16, 27 ... Transmission / reception device 26 ... Shooting device N ... Communication network

Claims (12)

A client device that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to the processing of the application program of the server device in response to the input event,
A display unit;
Application information transmitting means for transmitting information of an application program included in the client device itself to the server device;
In a state where the screen data is displayed on the display unit, and the capturing instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation,
Server processing data storage means for receiving and storing data of the processing result of the application program transmitted from the server device in response to a capture instruction by the capture instruction means;
Capture data display control means for displaying the data stored by the server processing data storage means on the display unit by an application program corresponding to the data;
Equipped with a,
The data of the processing result of the application program in the server device received and stored from the server device by the server processing data storage means is the information of the application program held by the client device itself transmitted by the application information transmitting means. Received as file data that the client device can open,
A client device. A client device that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to the processing of the application program of the server device in response to the input event,
A display unit;
And the screen size transmitting means for transmitting a screen size of the display unit to the server apparatus,
Capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit;
Server processing data storage means for receiving and storing data of the processing result of the application program transmitted from the server device in response to a capture instruction by the capture instruction means;
Capture data display control means for displaying the data stored by the server processing data storage means on the display unit by an application program corresponding to the data;
With
The processing result data of the application program in the server device received and stored from the server device by the server processing data storage unit corresponds to the screen size of the display unit transmitted by the screen size transmission unit. Received as image data divided into multiple sheets,
A client device. A client device that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to the processing of the application program of the server device in response to the input event,
A display unit;
Capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit;
Server processing data storage means for receiving and storing data of the processing result of the application program transmitted from the server device in response to a capture instruction by the capture instruction means;
Capture data display control means for displaying the data stored by the server processing data storage means on the display unit by an application program corresponding to the data;
Screen capture instruction receiving means for receiving a screen data capture instruction displayed on the display unit transmitted from the server device in response to a capture instruction by the capture instruction means;
When a capture instruction is received by the screen capture instruction receiving unit, a screen data storage unit that stores screen data displayed on the display unit;
A client device comprising: Photographing means;
A shutter key for shooting,
The capture instruction means transmits a capture instruction for the screen data to the server device in response to a user operation of the shutter key in a state where the screen data is displayed on the display unit.
The client device according to any one of claims 1 to 3 , wherein the client device is configured as described above. A server device that transmits screen data generated according to processing of an application program that operates in response to an input event from a client device connected via a network to the client device,
Capture instruction receiving means for receiving a capture instruction transmitted from the client apparatus for the screen data transmitted to the client apparatus;
Processing data transmission means for transmitting data of the processing result of the application program to the client device in response to reception of a capture instruction by the capture instruction receiving means;
Application information receiving means for receiving information of an application program of the client device transmitted from the client device;
Based on the information of the application program of the client device received by the application information receiving means, the determining means for determining whether the data of the processing result of the application program in the server device is data that can be opened by the client device; ,
Equipped with a,
When the processing data transmission unit determines that the data is to be opened by the client device by the opening determination unit in response to reception of the capture instruction by the capture instruction reception unit, the processing result of the application program in the server device To the client device as file data,
The server apparatus characterized by the above-mentioned. Screen size receiving means for receiving the screen size of the display unit in the client device transmitted from the client device;
When the processing data transmission unit determines that the data is not opened by the client device by the opening determination unit in response to reception of the capture instruction by the capture instruction receiving unit, the processing result of the application program in the server device Is transmitted to the client device as image data divided into a plurality of data corresponding to the screen size of the display unit in the client device received by the screen size receiving means.
The server device according to claim 5 . A storage capacity receiving means for receiving the storage capacity of the storage means in the client apparatus transmitted from the client apparatus;
The processing data transmission means includes
When the data of the processing result of the application program in the server device is image data divided into a plurality according to the screen size of the display unit in the client device received by the screen size receiving unit, the plurality of divisions Storage capacity judging means for judging whether or not the received image data fits in the storage capacity of the storage means in the client device received by the storage capacity receiving means,
When it is determined by the storage capacity determination means that the storage capacity of the client apparatus is within the storage capacity, the divided image data is transmitted to the client apparatus, and the storage capacity of the client apparatus must be within the storage capacity of the storage means. If it is determined, a screen data capture instruction generated according to the processing of the application program is transmitted to the client device.
The server device according to claim 6 . A server device that transmits screen data generated according to processing of an application program that operates in response to an input event from a client device connected via a network to the client device,
Capture instruction receiving means for receiving a capture instruction transmitted from the client apparatus for the screen data transmitted to the client apparatus;
Processing data transmission means for transmitting data of the processing result of the application program to the client device in response to reception of a capture instruction by the capture instruction receiving means;
Application information receiving means for receiving information of an application program of the client device transmitted from the client device;
With
The processing data transmission unit is configured to use, as the file data to be opened by the client device, the processing result data of the application program in the server device based on the application program information of the client device received by the application information receiving unit. Send,
The server apparatus characterized by the above-mentioned. Controls a computer of a client device that transmits an input event corresponding to a user operation to a server device connected via a network and receives screen data generated according to the processing of an application program of the server device in response to the input event A client control program for
The computer,
Application information transmitting means for transmitting information of an application program of the client device itself to the server device
Capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit;
Server processing data storage means for receiving processing result data of the application program transmitted from the server device in response to a capture instruction by the capture instruction means and storing the data in a storage unit;
Capture data display control means for causing the display unit to display data stored by the server processing data storage means by an application program corresponding to the data;
To function as,
The data of the processing result of the application program in the server device received and stored from the server device by the server processing data storage means is the information of the application program held by the client device itself transmitted by the application information transmitting means. Received as file data that the client device can open,
Computer readable client control program. Controls a computer of a client device that transmits an input event corresponding to a user operation to a server device connected via a network and receives screen data generated according to the processing of an application program of the server device in response to the input event A client control program for
The computer,
Screen size transmitting means for transmitting the screen size of the display unit to the server device;
Capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit;
Server processing data storage means for receiving and storing data of a processing result of the application program transmitted from the server device in response to a capture instruction by the capture instruction means;
Capture data display control means for causing the display unit to display data stored by the server processing data storage means by an application program corresponding to the data;
Function as
The processing result data of the application program in the server device received and stored from the server device by the server processing data storage unit corresponds to the screen size of the display unit transmitted by the screen size transmission unit. Received as image data divided into multiple sheets,
Computer readable client control program. A client device that transmits an input event corresponding to a user operation to a server device connected via a network, and receives screen data generated according to the processing of the application program of the server device in response to the input event,
Capture instruction means for transmitting a capture instruction for the screen data to the server device in response to a user operation in a state where the screen data is displayed on the display unit;
Server processing data storage means for receiving and storing data of a processing result of the application program transmitted from the server device in response to a capture instruction by the capture instruction means;
Capture data display control means for causing the display unit to display data stored by the server processing data storage means by an application program corresponding to the data;
Screen capture instruction receiving means for receiving a screen data capture instruction displayed on the display unit transmitted from the server device in response to a capture instruction by the capture instruction means;
When a capture instruction is received by the screen capture instruction receiving unit, a screen data storage unit that stores screen data displayed on the display unit;
A computer-readable client control program designed to function as a computer. A server control program for controlling a computer of a server device that transmits screen data generated in accordance with processing of an application program that operates in response to an input event from a client device connected via a network, to the client device,
The computer,
Capture instruction receiving means for receiving a capture instruction transmitted from the client apparatus for the screen data transmitted to the client apparatus;
Processing data transmission means for transmitting processing result data of the application program to the client device in response to reception of a capture instruction by the capture instruction reception means;
Application information receiving means for receiving information of an application program of the client device transmitted from the client device;
To function as,
The processing data transmission unit is configured to use, as the file data to be opened by the client device, the processing result data of the application program in the server device based on the application program information of the client device received by the application information receiving unit. Send,
Computer readable server control program that was so that is.

Images