JPH0721005A - Image display method for client/server system - Google Patents

Abstract

PURPOSE:To provide the method for displaying a context asynchronous with compressed window image data while matching them when executing window display while expanding and reproducing those data at the work station of a client/server system or the like. CONSTITUTION:An arbitration program 11 is provided at a client process part 3, when there is the display instruction of a window, the context (such as cursor data and image data under preparation) of a display controller 8 is temporarily saved by a server process part 4 and after the window image data are expansively reproduced and expanded in the frame buffer of the display controller 8, the context is recovered and displayed on the window image while being mixed. On the other hand, when an EXPOSE event is generated, a partial plotting program 12 provided at the client process part 3 executes EXPOSE plotting with the compressed image data as a target.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display method in a client / server system, which is applied to a workstation, a LAN (Local Area Network), etc., and is compressed in order to increase the display speed of a window image on a display. The present invention relates to a method of ensuring consistency with a window image when displaying an asynchronous context when image data is used, and a display method when an EXPOSE event occurs.

[0002]

2. Description of the Related Art Recently, in workstations and LANs, a system in which an operating system is regarded as an application platform and an application program has portability has become widespread. In addition, CUI centered on conventional character input / output
From (Character user interface), a GUI (Grafical user interface) based on a graphics function is utilized as an input interface.

When a GUI is used, graphic processing for displaying pictorial symbols (icons) and the like on the window screen is accompanied, and if the operating system executes all of the processing, the load becomes too large. A client program and a window system server program are provided as programs, and graphic processing is executed by these programs to enable high-speed display of input screens and the like. Furthermore, the above-mentioned client / server method is widely adopted not only for displaying window images, but also for executing various processing such as calculation processing and database input / output management. Efficient distributed processing is realized by providing a program and a server program.

By the way, when displaying a window image by the client / server method, the client process section saves the window display image data read from the library, and the client process section saves the window selection data instructed. Output to the server process section, the server process section returns the window position / range data corresponding to the window selection data to the client process section and notifies it, and the client process section system calls the display image data corresponding to the notification data. Transferred to the operating system by
The operating system transfers each transferred data to the server process unit, and while the server process unit manages the display control unit, the image data is assembled using the notification data (position / range data) and the frame buffer of the display control unit. And the display controller causes the display to display the selected window image.

Therefore, the operating system only executes the data transfer, and the server process unit manages the final display of the window image. In the above procedure, the raw data is used as the window display image data. Since it is handled and the display image data is transferred back and forth between the user process side (client process part and server process part) and the operating system side, it takes time to display the window image on the display. The problem of taking too much arises. Also, since the number of system calls increases, the overhead becomes heavy, and it is necessary to prepare a large amount of memory for the client process part. Furthermore, for the library, the memory occupation rate of the window display image data is also increased. There are disadvantages such as higher costs.

Therefore, for the purpose of solving the above-mentioned problems, the applicant of the present invention said, "In addition to registering the image data of the window as compressed image data in the library, an image data decompressing device is provided and selected. A method of displaying a window in which compressed image data of a window is transferred from the client process unit to the device driver of the operating system so that the operating system plays the window image while controlling the image data decompression device. Patent application filed on May 28, 2014: "Window display method in client / server method")
Is proposed.

[0007]

However, when the compressed data is used as the window image data as in the contents of the proposal, the operating system executes the image data decompression device and the display control unit under the control of the window image display. On the other hand, the context of cursor data, image data being created, etc. will be executed by the server process part in the original procedure, and since both image data are asynchronous, there is no way to display them together on the display. It needs arbitration. Further, when the windows are moved or the degree of overlapping is changed in the multi-window display state, the EXPOSE event is generated, and in that case, the arbitration function similar to the above is required.

On the other hand, if a save area that the operation system and the server process section independently manage is provided in the frame buffer of the display controller and the display image is selectively managed by the attribute data, simple memory control is performed. Although it is possible to eliminate the above asynchronous relationship, it is necessary to prepare a frame buffer with a large capacity, which causes an increase in hardware cost. In general, in the client / server method, the compressed image is expanded on the server process side. The problem arises that the server process part side must be expanded because the program is not written assuming.

Therefore, according to the present invention, when the compressed data is used as the window image data, the window image data can be processed by software without using a frame buffer having a large capacity and without expanding the server process side. It was created for the purpose of ensuring the consistency of the display of the context that is asynchronous with the display.

[0010]

According to the present invention, compressed image data of a window is read out from a library and saved in a client process section, and the client process section executes a server process based on a window selection display request from an operation section. Send window selection data to
The server process unit notifies the client process unit of the position / range data of the window image corresponding to the selection data, and the client process unit performs the operation of the notification data and the image data of the window corresponding to the notification data. To the system and the operating system transfers the compressed image data to the image data decompression device while controlling the image data decompression device using the notification data to reproduce the display image data. A client for displaying a window image based on the reproduction data on a display /
In the server-based image display method, an arbitration program that arbitrates the display of the compressed image data of the window and the display of the context asynchronous with the compressed image data is provided in the client process unit, and a window selection display request is issued from the operation unit. In this case, based on the arbitration program of the client process unit, the context being displayed by the operating system is saved in the server process unit, the window image is displayed on the display, and then the operating system is An image table in the client / server system characterized in that the context image of the server process unit is restored and expanded in the frame buffer of the display control unit so that the image of the context is mixedly displayed in the window image of the display. To a method.

Further, when the EXPOSE event occurs in the window image, the procedure of the above-mentioned invention is executed, but regarding the partial drawing at that time, a partial drawing program for the compressed data of the window image is executed in the client process section. Is provided, the client process section detects position / range data related to partial drawing from the event data of the server process section based on the partial drawing program, and the compressed image data of the window saved by the client process section is detected. The compressed image data corresponding to the position / range data is read out, and the operating system controls the image data expansion device using the position / range data to reproduce the display image data,
It can be executed by expanding the reproduction data in the display control unit.

[0012]

Since the context has an asynchronous relationship with the window image data because the compressed data is used as the window image data, in the present invention, when the window and the context are mixedly displayed on the display, the context is written to the client process section. The display procedure of each data is arbitrated based on the arbitration program. That is, since the procedure of temporarily saving the context inside the server process unit, displaying the window image data and then restoring the context is executed, a frame buffer for one frame is provided in the display control device. Just by setting it, it is possible to ensure the consistency of the mixed display.

On the other hand, when an EXPOSE event related to a window occurs, it is naturally necessary to perform partial drawing using compressed data. Regarding this function, the client process section side is also provided with a partial drawing program for compressed data. The EXPOSE event can be managed simply by setting it in advance. Consistency in mixed display can be ensured by executing the above-mentioned display procedure for the context.

[0014]

Embodiments of the image display method in the client / server system of the present invention will be described in detail below with reference to the drawings. First, FIG. 1 shows a system configuration diagram of a window display system in a workstation, and a computer 1 has an operating system 2, a client process unit 3 ported as a user program, and a server process unit 4 for a window system. ing.
In addition, the computer 1 has a keyboard 5 and a mouse 6 as input operation units, and compressed image data [JPEG (Join
t The library 7 in which compressed data by photographic coding exparts group) and the like are registered, and the display unit (display control unit 8 and display 9) are connected, but JPEG data is decoded before the display control unit 8. An image data decompression device 10 and a partial drawing device 10a for expanding the display image data in the frame buffer of the display control unit 8 by the DMA method are provided.

The system of this embodiment is characterized in that the arbitration program 11 and the partial drawing program 12 are written in the client process section 3. Here, the arbitration program 11 is a program that performs arbitration when the window image data and the context managed by the client process unit 3 are mixedly displayed on the display 9, and the partial drawing program 12 is used to move or overlap windows. This program executes partial drawing for compressed data when an EXPOSE event associated with the change occurs.

Next, the procedure for displaying window image data and context (for example, cursor data) by the system of this embodiment will be described with reference to the flowchart of FIG. First, as a premise, the compressed image data of the window is read from the library 7 and saved in the internal memory of the client process unit 3. Also, the cursor data indicating the position of the cursor is obtained from the mouse 6, but it is written in the server process unit 4 via the operating system 2, and the operating system 2 is the cursor management data of the server process unit 4. The cursor drawing data is expanded into the frame buffer of the display control device 8 by using to display the cursor at the corresponding position on the display 9, while for the compressed data of the window image, the library 7 → client process unit 3 → operating system. The image data for display reproduced by the image data decompressing device 10 transferred from the image data decompressing device 2 to the image drawing device 10a → the partial drawing device 10a → the display control device 8 is displayed on the display 9.

When a new window image display instruction is issued by operating the keyboard 5 or the mouse 6 while the context or window image is being displayed, the arbitration program 11 of the client process unit 3 is activated and the operating system 2 The cursor data at that time is saved inside the server process unit 4 (S1, S2).

Here, the client process unit 3 transfers the window selection data based on the instruction to the server process unit 4, and the server process unit 4 sends the position / range data of the window corresponding to the window selection data to the client process unit 4. It returns to 4 and notifies (S3, S4).
On the other hand, the client process unit 3 which has received the notification reads the compressed image data of the selected window from the internal memory, and the compressed image data is stored in the device driver of the operating system 2 together with the notification data (position / range data) by a system call. Transfer to (S5, S6).

Then, the device driver of the operating system 2 converts the compressed image data into an image data expansion device.
The image data decompression device 10 decompresses and reproduces the compressed image data in sequence, and at that time, the operating system 2 uses the notification data (position / range data) to partially reconstruct the image data decompression device 10. By controlling the drawing device 10a, the display image of the window is expanded in the frame buffer of the display controller 8 and the selected window image 13 is displayed on the display 9 (S7 to S9).

Here, although the cursor data is saved in the server process unit 4 by the initial procedure (S2), when the operating system 2 confirms the display completion state of the window image from the display control unit 8, the client process The cursor data of the server process unit 4 is restored based on the arbitration program of the unit 11, and the cursor data is expanded in the frame buffer of the display control unit 8 (S1
0, S11). As a result, after the selected window image 13 is displayed on the display 9, the cursor 14 is immediately displayed at the position corresponding to the cursor data saved by the server process unit 4 (S12). Then, thereafter, data processing based on various operations using the mouse 6 and the keyboard 5 is executed, but if there is a window display instruction, the above procedure is repeated again (S13 → S1).

Next, the procedure for displaying the window image data and the context when the EXPOSE event occurs will be described with reference to the flowchart of FIG. Incidentally, in this embodiment, as shown in FIG.
A case where the window B is changed to the window A while the multi-window image including B, C, and D is displayed will be described as an example.

First, if there is a change in the degree of window overlap (change in layout) from the keyboard 5 or mouse 6,
The server process unit 4 uses the E
The XPOSE event is notified to the client process unit 3, and the context being displayed by the operating system 2 is saved inside the server process unit 4 (S21 to S23). That is, as shown in FIG. 4A, the cursor 14 and the context image (scattered area) 15 being created are displayed in the multi-window image.
When is displayed, the contexts developed in the frame buffer of the display control unit 8 are saved in the server process unit 4.

Here, the client process unit 3 uses EXPOS
The E-event window selection data is transferred to the server process unit 4, but the server process unit 4 returns the window position / range data corresponding to the transferred data to the client process unit 3 to notify it (S24, S25).
Then, the client process unit 4 determines the drawing position / range based on the position / range data of the window saved in the internal memory and the notification data, and activates the partial drawing program 12 at that stage (S26).

Upon activation of the partial drawing program 12, the client process section 3 reads out partial drawing data corresponding to the drawing position / range data from the compressed image data of the saved window and transfers it to the operating system 2. (S27). That is, in the case of FIG. 4, the overlapping area of the window A and the window B [hatched area in FIG. 4B] corresponds to the partial drawing area by changing the overlapping degree of the windows. The compressed image data of the rectangular area is transferred.

Thereafter, as in the above-described embodiment, the compressed image data for partial drawing described above is transferred to the client program unit 3.
→ Operating system 2 → Image data expansion device 10
Will be transferred to the operating system 2
Expands the display image data reproduced while controlling the DMA functions of the image data decompressing device 10 and the partial drawing device 10a in the frame buffer of the display control device 8 and converts it into the position / range data transferred from the client process unit 3. The display image data of the corresponding area is rewritten (S28, S29). Therefore,
In the system of this embodiment, it is sufficient to prepare a display memory for one frame in the frame buffer of the display control device 8 according to the procedure based on the partial drawing program 12 of the client process unit 3, and of course, selection by attributes. No need to display.

Then, the operating system 2 confirms from the display control unit 8 that the partial drawing is completed, restores the context of the server process unit 4 based on the arbitration program of the client process unit 11, and controls the display of the context. Expand to the frame buffer of part 8
(S30-S32). As a result, the display 9 is shown in FIG.
As shown in, the cursor 14 was saved by the server process unit 4 immediately after the partial drawing area (hatched area) was displayed EXPOSE and the context image (scattered area) 15 being created.
Will be displayed (S33).

[0027]

The image display method in the client / server system of the present invention has the following effects due to the above configuration. According to the invention of claim 1, when the compressed data is used as the window image data and the window image is displayed by decompressing and reproducing it, based on the arbitration program written in the client process unit,
In the window image display stage, the context that is asynchronous with the window image data, such as cursor data and image data being created, is temporarily saved in the server process part, and the window image is displayed and then restored. It is possible to display the image of the context with consistency while displaying the image at high speed. According to the second aspect of the present invention, the client process section is provided with the partial drawing program for the compressed data of the window image, thereby enabling the quick partial drawing at the EXPOSE event using the compressed data. Further, in both inventions, since the display of the window image and the context image is arbitrated and controlled, there is no need for selection control by attributes, and the frame buffer of the display control unit also has a memory area for one frame. It's enough. Further, there is an advantage that it is not necessary to expand the server process unit by only writing the arbitration program and the partial drawing program in the client process unit.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of a window display system in a workstation to which an image display method in a client / server system of the present invention is applied.

FIG. 2 is a flowchart showing a procedure for displaying window image data and context when there is a window display instruction.

FIG. 3 is a flowchart showing a procedure for displaying window image data and context when an EXPOSE event occurs.

FIG. 4 is a diagram showing a window screen when an EXPOSE event occurs.

[Explanation of symbols]

1 ... Computer, 2 ... Operating system, 3 ...
Client process part, 4 ... Server process part, 5 ... Keyboard (operation part), 6 ... Mouse (operation part), 7 ... Library, 8 ... Display control part, 9 ... Display, 10 ... Image data expansion device, 10a ... Part Drawing device, 11 ... Arbitration program, 1
2 ... Partial drawing program, 13 ... Window image, 14 ... Cursor, 15 ... Context image.

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] September 22, 1994

[Procedure Amendment 1]

[Document name to be amended] Statement

[Name of item to be corrected] Claim 1

[Correction method] Change

[Correction content]

[Procedure Amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0010

[Correction method] Change

[Correction content]

[0010]

According to the present invention, compressed image data of a window is read out from a library and saved in a client process section, and the client process section executes a server process based on a window selection display request from an operation section. Send window selection data to
The server process unit notifies the client process unit of the position / range data of the window image corresponding to the selection data, and the client process unit performs the operation of the notification data and the image data of the window corresponding to the notification data. To the system, and the operating system transfers the compressed image data to the image data decompressing device while controlling the image data decompressing device using the notification data to reproduce the display image data. A client for displaying a window image based on the reproduction data on a display /
In the image display method in the server system, an arbitration program that arbitrates the display of the compressed image data of the window and the display of the context asynchronous to the compressed image data is provided in the client process unit, and a window selection display request is issued from the operation unit. when Tsu, based on the arbitration program of the client process unit, a context While browsing retracted by the server process unit, after displaying the window image on the display, to return the context of the previous SL server process unit The above-mentioned operation
The image display method in the client / server system is characterized in that the context system is mixedly displayed in the window image of the display by expanding it in the frame buffer of the display control unit.

[Procedure 3]

[Document name to be amended] Statement

[Correction target item name] 0017

[Correction method] Change

[Correction content]

[0017] Now, when the display instruction of the newly window image is made by operating the keyboard 5 or mouse 6 while viewing the context or window image, arbitration program 11 of the client process portion 3 is started, at the time of its The cursor data is saved inside the server process unit 4 (S1, S2).

[Procedure amendment 4]

[Document name to be amended] Statement

[Name of item to be corrected] 0022

[Correction method] Change

[Correction content]

First, if there is a change in the degree of window overlap (change in layout) from the keyboard 5 or mouse 6,
The server process unit 4 uses the E
Notifies XPOSE event to the client process unit 3, evacuates the context table <br/> While browsing within the server process portion 4 (S21 to S23). That is, as shown in FIG. 4A, when the cursor 14 or the context image (scattered area) 15 being created is displayed in the multi-window image, it is expanded in the frame buffer of the display controller 8. The server process unit 4 saves those stored contexts.

[Procedure Amendment 5]

[Document name to be amended] Statement

[Name of item to be corrected] 0024

[Correction method] Change

[Correction content]

[0024] By activation of the partial drawing program 12, client process unit 3 transfers the drawing position and range data and the compressed image data of the windows that are saved are read to the operating rating system 2 (S27). That is, in the case of FIG. 4, the overlapping area of the window A and the window B is changed by changing the overlapping degree of the windows [FIG.
The hatched area] corresponds to the partial drawing area, and the compressed image data of the rectangular area of window B is transferred.

[Procedure correction 6]

[Document name to be corrected] Drawing

[Name of item to be corrected] Figure 2

[Correction method] Change

[Correction content]

[Fig. 2]

[Procedure Amendment 7]

[Document name to be corrected] Drawing

[Name of item to be corrected] Figure 3

[Correction method] Change

[Correction content]

[Figure 3]

Claims (2)

[Claims] 1. The compressed image data of the window is read from the library and saved in the client process section, and the client process section sends the window selection data to the server process section based on a window selection display request from the operation section. Then, the server process unit notifies the client process unit of the position / range data of the window image corresponding to the selection data, and the client process unit notifies the notification data and the image data of the window corresponding to the notification data. Transfer to the operating system, and the operating system transfers the compressed image data to the image data expansion device while controlling the image data expansion device using the notification data to reproduce the image data for display, and display control The device uses the playback data In the image display method in the client / server method for displaying the window image on the display according to the above, an arbitration program for arbitrating the display of the compressed image data of the window and the display of the context asynchronous to the compressed image data is provided in the client process section, When a window selection display request is issued from the operation unit, the context displayed by the operating system is saved in the server process unit based on the arbitration program of the client process unit, and the window image is displayed on the display. After that, the operating system restores the context of the server process unit and expands it in the frame buffer of the display control unit, so that the image of the context is mixedly displayed in the window image of the display. Image display method in a client / server scheme wherein Rukoto. 2. A client process section is provided with a partial drawing program intended for compressed data of a window image, and when an EXPOSE event occurs in the window image, the client process section uses a server based on the partial drawing program. A position / range data related to partial drawing is detected from the event data of the process section, and compressed image data corresponding to the position / range data is read out from the compressed image data of the window saved by the client process section, thereby operating system. 2. The client / server system according to claim 1, wherein the control unit controls the image data decompressing device using the position / range data to reproduce the display image data, and causes the display control device to execute partial drawing by the reproduced data. Image display method in.