JP2007004228A - Web application system, remote operation server program and remote operation client program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a Web application system for enabling a Web client device to plot the CG of a three-dimensional model at a high speed even when a service for operating modeling is provided from a Web application server device to a client device. <P>SOLUTION: In such a case that the image of a picture for operating an application 29 for modeling in a Web application server device 20 is displayed in a Web browser 17 window of a Web client device 10, when an operation is performed for a three-dimensional model whose CG should be displayed on the picture, the Web application server device 20 transmits a plotting command for plotting the CG of the three-dimensional model to a Web client device 10. The Web client device 10 plots the CG of the three-dimensional model by using a self-graphic accelerator according to the plotting command. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a web application system for remotely operating a modeling application in a web application server device within a web browser window of the web client device, and a computer as the web application server device and web client device of such a web application system. Relates to a remote operation server program and a remote operation client program.

  As is well known, a web application server device is a device that provides a service by an application activated on the server side on a web client device via a network.

  Conventionally, a CAD [Computer Aided Design] service for creating (drawing) a two-dimensional model has been provided from a web application server device, but recently, a three-dimensional model such as 3D CAD or animation production has been provided. There is a demand for providing a service for creating a model (modeling) from a web application server device.

  In providing such a modeling service, the web application server apparatus generates image data such as a bitmap based on CG [Computer Graphics] created by the application for the three-dimensional model, and the image data is generated by the web client. Send to. The web client device displays an image in a state where the three-dimensional model is viewed from one direction based on the image data.

  By the way, when an application for modeling is activated on a stand-alone computer, for example, when displaying a wire frame model or a surface model of a three-dimensional model while changing the viewing direction, the three-dimensional model is smooth. The CG is drawn at high speed so as to change the direction. For such high-speed drawing, a graphic accelerator built in the computer is used to reduce the load on the CPU of the computer.

  However, even if an attempt is made to perform high-speed CG rendering such as changing the orientation of the three-dimensional model in the web client device by the service provided by the web application server device, only image data is provided to the web client device. CG cannot be drawn at high speed using a graphic accelerator.

  Further, in the web application server apparatus, it is not considered that image data is sequentially generated at a high speed by following the high-speed rendering of CG. However, in this case, the load on the web application server apparatus increases tremendously and network traffic is increased. In the end, it is considered that the web client device cannot display the three-dimensional model so that its orientation changes smoothly.

  The present invention has been made in view of the above-described problems of the prior art, and the problem is that even when a service for performing modeling is provided from a web application server apparatus to a web client apparatus, The object is to make the CG of the three-dimensional model drawn at high speed in the client device.

  A web application system invented to solve the above problems is a web application system for remotely operating a modeling application in a web application server device in a web browser window of one or more web client devices. In response to a request from any of the web client devices, the web application server device transmits screen image data for displaying a screen image for operating the modeling application to the web client device. A screen transmission unit, an operation reception unit for receiving operation event information indicating an operation event made on the screen from the web client device, and an operation received by the operation reception unit When the operation event indicated by the event information is for a three-dimensional model on which CG is to be displayed on the screen, a drawing command is acquired for acquiring a drawing command for drawing the CG from the modeling application. And a drawing command transmission unit that transmits the drawing command acquired by the drawing command acquisition unit to the web client device, while the web client device operates a request to remotely operate the modeling application in the input device A request transmission unit that transmits the request to the web application server device when received from a person, a screen display unit that displays a screen based on the screen image data when the screen image data is received from the web application server device, screen When an operation event made in is detected, an operation transmission unit that transmits operation event information indicating the operation event to the web application server device. When a drawing command is received from the web application server device, a three-dimensional model based on the drawing command Is provided with a CG drawing unit that draws a CG of the three-dimensional model in the area of the screen to be drawn.

  With this configuration, when an image of a screen for operating the modeling application in the web application server device is displayed in the web browser window of the web client device, a CG is displayed on the screen. When an operation is performed on a three-dimensional model, the web application server device does not transmit the image data of the screen after rendering the CG of the three-dimensional model to the web client device, but the CG of the three-dimensional model. A drawing command for drawing is transmitted to the web client device. As a result, the web client device can draw the CG of the three-dimensional model using its own graphic accelerator according to the drawing command.

  In addition, a remote operation server program invented to solve the above-described problem is a modeling application that receives a request from one of one or more web client devices connected to a computer via a communication device. Screen transmission means for transmitting screen image data for displaying an image of a screen for operating to the web client device via the communication device, and an operation event made on the screen from the web client device Operation receiving means for receiving operation event information from the web client device via the communication device, and a three-dimensional model in which an operation event indicated by the operation event information received by the operation receiving means is to display CG on the screen. The modeling application. A drawing command acquisition means for acquiring a drawing command for drawing the CG from the application, and a drawing command transmission for transmitting the drawing command acquired by the drawing command acquisition means to the web client device via the communication device It is characterized by functioning as a means.

  Therefore, the remote operation server program can cause the computer to function as an apparatus equivalent to the web application server apparatus constituting the web application system of the present invention described above.

  In addition, a remote operation client program invented to solve the above-mentioned problem is a request from an operator at the input device to remotely operate a computer for modeling application of a web application server device connected via a communication device. Request accepting means for accepting, request sending means for sending the request accepted by the request accepting means to the web application server device via the communication device, and receiving the screen image data from the web application server device via the communication device Then, screen display means for displaying the screen on the display device based on the screen image data, and when an operation event made on the screen is detected, operation event information indicating the operation event is sent to the web application server device to the communication device When a drawing command is received from the web application server device via the communication device, the CG of the three-dimensional model based on the drawing command is converted into the CG of the three-dimensional model of the screen. It is characterized by functioning as CG drawing means for drawing in a region to be drawn.

  Therefore, the remote operation client program can cause the computer to function as an apparatus equivalent to the web client apparatus constituting the web application system of the present invention described above.

  As described above, according to the present invention, when a service for performing modeling is provided from a web application server apparatus to a web client apparatus, a CG of a three-dimensional model is rendered at high speed on the web client apparatus. Become.

  Hereinafter, one embodiment for carrying out the present invention will be described with reference to the accompanying drawings.

  First, the configuration of the computer network system of this embodiment will be described.

  FIG. 1 is a diagram showing a configuration of a computer network system according to the present embodiment.

  The computer network system according to the present embodiment includes one or more web client devices 10 and a web application server device 20, and the devices 10 and 20 are connected to each other via a network N.

  The web client device 10 will be briefly described. The web client device 10 is a device configured to function as a web client by installing a web browser 17 to be described later on a generally available personal computer.

  The web application server device 20 will be briefly described. The web application server device 20 is configured to function as a web server by installing a later-described page data 26 and a web server program 27 on a general-purpose computer such as a mainframe. Device.

  FIG. 2 is a diagram schematically showing the configuration of the web client device 10.

  As is well known, the personal computer constituting the web client device 10 includes a display device 10a such as a liquid crystal display, an input device 10b such as a keyboard and a mouse, and a main body 10c connected to these devices. .

  The main body 10 c includes known hardware such as a CPU [Central Processing Unit] 11, a DRAM [Dynamic Random Access Memory] 12, a communication adapter 13, an MDD [Multi Disk Drive] 14, and an HDD [Hard Disk Drive] 15. Among these, the HDD 15 controls input / output in the display device 10a and the input device 10b, controls communication in accordance with TCP / IP (Transmission Control Protocol / Internet Protocol) in the communication adapter 13, and DRAM 12 Basic functions such as read / write control for storage areas (storage elements, CD [Compact Disk], DVD [Digital Versatile Disk], HD [Hard Disk] storage areas) of MDD14 and HDD15 are provided to many application software The basic software 16 is stored.

  A web browser 17 and a remote operation client module 18 are installed in the HDD 15 of the web client device 10.

  The web browser 17 is a program for adding a function as a web client to a personal computer, and more specifically, page data and images from a URL [Uniform Resource Locator] specified by an operator of the web client device 10. This is a program for acquiring data or the like and displaying a web page or an image on the display device 10a.

  The remote operation client module 18 is a program for remotely operating an application in the web application server device 20 on the web client device 10. The remote operation client module 18 has a function of detecting an operation event of clicking or dragging with a mouse or a key press on a keyboard, and a remote operation server module to be described later installed in the web application server device 20 with information related to the operation event. 28, and a function for receiving and displaying the processing result output by the application that has received the operation event information from the remote operation server module 28, is given to the personal computer.

  FIG. 3 is a configuration diagram schematically showing the configuration of the web application server device 20.

  The general-purpose computer constituting the web application server apparatus 20 incorporates well-known hardware such as a CPU 21, a DRAM 22, a communication adapter 23, and an HDD 24. Among these, the HDD 24 is based on TCP / IP in the communication adapter 23. Basic software 25 for providing basic functions such as control of communication and control of reading and writing to the storage area (storage element, storage area of HD) of DRAM 22 and HDD 24 to many application software is stored. is doing.

  In the HDD 24 of the web application server device 20, page data 26, a web server program 27, a remote operation server module 28, and a CAD [Computer Aided Design] application 29 are installed.

  The page data 26 is data including text described in a markup language. These page data 26 are data prepared for establishing a website on the network N, and each of these page data 26 has a URL defined. One of the page data 26 includes a start instruction command for a CAD application 29 described later.

  The web server program 27 is a program for transmitting the requested page data 26 in response to a request from the web client device 10. Further, the web server program 27 realizes a function of requesting the remote operation server module 28 (to be described later) to start an application when the page data 26 of the URL specified by the web client device 10 includes an application start instruction command. It has become something to do.

  The remote operation server module 28 enables remote operation of the application in the web application server device 20 by the operator of the web client device 10 by cooperating with the remote operation client module 18 in the web client device 10 described above. It is a program. The remote operation server module 28 establishes communication with the web client device 10 according to a protocol such as RDP [Remote Desktop Protocol] or ICA [Independedt Computing Architecture], and is operated from the web client device 10 of the communication destination. A function for receiving event information, a function for notifying the application of the contents of the operation event indicated by the operation event information, a function for generating image data of a screen image for displaying the processing result of the application, and the image data as RDP communication or ICA A function of transmitting to the remote operation client module 18 of the web client device 10 through communication is given to the general-purpose computer.

  The CAD application 29 is a program for giving a computer at least a function for creating (modeling) a three-dimensional model on a display device. The CAD application 29 may be capable of providing a computer with a function for creating (drawing) a two-dimensional model. The three-dimensional model created on the CAD application 29 is displayed on the display device as CG [Computer Graphics].

  Next, the content of the part relevant to this invention among the processes performed in the web application server apparatus 20 is demonstrated.

  When the operator of the web client device 10 starts the web browser 17 by operating the input device 10b, the screen for operating the web browser 17 is displayed on the display device 10a by the function of the basic software 16. A window is displayed. Then, the operator inputs the URL of the page data 26 including the activation instruction command of the CAD application 29 in a predetermined input field on the screen in the window, and inputs an access instruction. Then, the web browser 17 (CPU 11 according to) sends a request message including the URL to the web server program 27 (CPU 21 according to the web application server device 20) in communication according to HTTP [HyperText Transfer Protocol]. Send to.

  Then, the web server program 27 reads the page data 26 at the URL specified through the request message. When the web server program 27 detects that the page data 26 includes an activation instruction command for the CAD application 29, the remote operation server module 28 is activated using this as a trigger. 4 to 7 are diagrams showing a flow of processing executed by the CPU 21 in accordance with the remote operation server module 28. FIG.

  After the start of processing, the remote operation server module 28 (the CPU 21 according to it) secures a memory area for the web client device 10, and generates a process of the designated CAD application 29 in this memory area (S101). In this memory area, information related to the window and icon being displayed, and operation event information are also managed. The generation and deletion of the memory area secured for each web client device 10 is managed by the remote operation server module 28 in a session space in another memory area.

  Subsequently, the remote operation server module 28 notifies the remote operation client module 18 of the port number assigned to the CAD application 29 through the virtual channel, and communicates with the remote operation client module 18 to the RDP or ICA. The communication thus established is established (S102).

  Thereafter, the remote operation server module 28 stands by until screen data for displaying a screen for operating the CAD application 29 is received from the process generated in step S101 (S103; NO).

  When receiving screen data from the process (S103; YES), the remote operation server module 28 generates image data of the screen image indicated by the screen data (S104), and the data to be incorporated into the response message. To the web server program 27 (function according to the CPU 21 according to) (S105). When the web server program 27 receives the image data, it is included in the body of the response message and transmitted to the web browser 17 of the web client device 10 by HTTP communication. When the web browser 17 receives the response message, the screen image by the CAD application 29 is displayed in the window for the web browser 17 based on the image data included in the response message. At this time, the web browser 17 places a transparent plane for detecting mouse clicks and cursor input in front of the screen image and waits for an operation event.

  In addition, CPU21 which performs step S101-S105 demonstrated above is corresponded to the screen transmission part and screen transmission means which were mentioned above.

  After execution of step S105, the remote operation server module 28 receives an instruction to terminate the CAD application 29 from the web client device 10, receives information related to an event other than an operation, and performs an operation related to an operation event of a click, drag, or key input. It waits until any event information is received (S106; NO, S107; NO, S108; NO). In the event other than the operation, for example, in the web client device 10, after another application window overlaps the front side of the web browser 17 window, the web browser 17 window is displayed again on the front side. In addition, since the screen image of the CAD application 29 in the window for the web browser 17 is missing, an event in which the remote operation client module 18 requests image data of the screen image for redisplaying the screen image. is there.

  When an end instruction is received from the web client device 10 through RDP communication or ICA communication during execution of such a processing loop (S106; NO, S107; NO, S108; NO) (S106; YES), remote operation is performed. The server module 28 disconnects communication with the remote operation client module 18 (S109), deletes the process (S110), and ends the processes according to FIGS.

When information related to an event other than an operation is received from the web client device 10 through RDP communication or ICA communication during execution of the processing loop (S106; NO, S107; NO, S108; NO) (S107; YES) The remote operation server module 28 instructs the process to generate screen data for displaying the screen of the CAD application 29 (S111), and waits until the screen data is received from the process (S112; NO). ). Thereafter, when screen data is received (S112; YES), the remote operation server module 28 generates image data of the screen image indicated by the screen data (S113), and the image data is transmitted to the web client device through RDP communication or ICA communication. 10 to the remote operation client module 18 (S114), and the above processing loop is resumed (S106; NO, S107; NO, S108; NO).
The remote operation client module 18 that has received the image data passes the image data to the web browser 17, and the web browser 17 displays a screen image based on the image data in a window for the web browser 17.

  When operation event information is received from the web client device 10 through RDP communication or ICA communication during execution of the processing loop (S106; NO, S107; NO, S108; NO) (S108; YES), remote operation is performed. The server module 28 notifies the content of the operation event to the process (S121). The CPU 21 that executes step S108 corresponds to the above-described operation receiving unit and operation receiving means.

  Thereafter, the remote operation server module 28 waits until receiving the response data, that is, the processing result obtained by executing according to the operation event from the process (S122; NO). The CAD application 29 requests the remote operation server module 28 for the process of drawing the CG of the three-dimensional model. In this case, for example, an OpenGL command for drawing the CG of the three-dimensional model. The group is delivered to the remote operation server module 28. Further, the CAD application 29 itself performs processes other than the process of drawing the CG of the three-dimensional model. In this case, the CAD application 29 displays the two-dimensional model displayed by an operation event. Window content data for displaying a creation (drafting) window or GUI [Graphical User Interface] part is generated, and this window content data is delivered to the remote operation server module 28.

  When data is received from the process (S122; YES), the remote operation server module 28 determines whether or not the data includes a 3D model creation (modeling) window creation command (S123). ).

  If the data received from the process includes a modeling window creation command (S123; YES), the remote operation server module 28 draws a three-dimensional model in the window with the command group included in the data. A graphic context defining what is to be done is generated (S124), and this graphic context is registered in the window management table (S125).

  Specifically, first, the process assigns window IDs as identification information for individually identifying all windows in the screen for operating the CAD application 29, so that remote operation is performed. The server module 28 acquires the window ID of the modeling window from the process. Subsequently, the remote operation server module 28 records a record including the window ID and information indicating the storage location of the generated graphic context in the window management table. FIG. 8 shows an example of the data structure of the window management table 31. As shown in FIG. As shown in FIG. 8, the window management table 31 has the same number of records as all the modeling windows in the screen for operating the CAD application 29. ”And“ storage position information ”fields. In the “window ID” field, the window ID of the modeling window is recorded, and in the “storage position information” field, information indicating the storage position of the graphic context is recorded.

  After the remote operation server module 28 registers the graphic context in the window management table 31 shown in FIG. 9, the data received from the process includes a CG drawing command group of the 3D model in the modeling window. It is determined whether or not there is (S126).

  On the other hand, if the data received from the process does not include the modeling window creation command (S123; NO), the remote operation server module 28 receives the process from the process without generating and registering the graphic context. It is determined whether or not the data includes a CG drawing command group of the three-dimensional model in the modeling window (S126).

  If the data received from the process includes a CG drawing command group of the three-dimensional model in the modeling window (S126; YES), the remote operation server module 28 transmits the drawing command group using a unique protocol. Is converted into a transmission form for the purpose (S127). Since each graphic-related command is transmitted using a unique protocol, a separate transmission form is defined in advance, and the remote operation server module 28 transmits the graphic-related command according to this definition. Convert to form. For example, if a command V can have attribute values p and q, the command V is converted into a record such as (1, p, q), and a command W is an attribute value. If it is possible to have r, s, t, processing is performed so that the command W is converted into a record such as (2, r, s, t).

  The CPU 21 that executes steps S122 and S126 corresponds to the drawing command acquisition unit and the drawing command acquisition unit described above.

  Thereafter, the remote operation server module 28 performs a process of transmitting the drawing command group converted into the transmission form according to the unique protocol to the remote operation client module 18 (S128), and restarts the above processing loop (FIG. 4) ( S106; NO, S107; NO, S108; NO).

  On the other hand, when the data received from the process does not include the CG drawing command group of the 3D model in the modeling window (S126; NO), the data is used to display the drafting window or GUI part. Since it is window content data, the remote operation server module 28 performs processing to generate image data of an image of a window (drawing window or GUI part) indicated by the window content data (S131).

  Subsequently, the remote operation server module 28 reads information indicating the position where the window is to be displayed from the window content data, and uses the image data and the position information as the remote operation client of the web client device 10 through RDP communication or ICA communication. Processing to transmit to the module 18 is performed (S132). The remote operation client module 18 that has received the image data and the position information passes the image data to the web browser 17, and the web browser 17 displays a screen image based on the image data in the operation screen of the CAD application 29. Is displayed at the position indicated by the position information.

  Thereafter, the remote operation server module 28 acquires from the process the window position management table used by the process to manage all windows in the operation screen of the CAD application 29 (S133). FIG. 9 is a diagram showing an example of the data structure of the window position management table 32. As shown in FIG. 9, the window position management table 32 has the same number of records as all the windows included in the screen for operating the CAD application 29. Each record has fields of “window ID”, “X1”, “Y1”, “X2”, “Y2”, and “front display order”. A window ID is recorded in the “window ID” field. The window referred to here includes GUI parts such as a drop-down list box and a tool box as well as a modeling window and a drafting window. In the fields “X1”, “Y1”, “X2”, and “Y2”, the X coordinate and Y coordinate of the upper left corner of the window and the X coordinate and Y coordinate of the lower right corner of the window are recorded. . In the “front display order” field, a priority order that defines which window should be displayed on the front side when the windows are displayed in an overlapping manner is recorded.

  After the remote operation server module 28 obtains such a window position management table 32 from the process, the window indicated by the window content data received from the process is arranged on the front side in the operation screen of the CAD application 29. It is determined whether or not there is a window to be hidden by (S134).

  In the operation screen of the CAD application 29, when there is no window that is hidden by placing the window indicated by the window content data on the front side (S134; NO), the remote operation server module 28 Then, the above processing loop (FIG. 4) is resumed (S106; NO, S107; NO, S108; NO).

  On the other hand, in the operation screen of the CAD application 29, when there is a window that is partially hidden by the window indicated by the window content data being arranged on the front side (S134; YES), the remote operation server module 28 determines whether a modeling window is included in a window that is partially hidden (S135).

  If the modeling window is not included in the window that is partially hidden by placing the window indicated by the window content data on the front side (S135; NO), the remote operation server module 28 Is resumed (S106; NO, S107; NO, S108; NO).

  On the other hand, if a window for modeling is included in a window that is partially hidden by placing the window indicated by the window content data on the front side (S135; YES), the remote operation server module 28 performs the modeling. The following processing is executed for each modeling window by specifying the processing windows as processing targets one by one (S136, S139; NO).

  That is, when the remote operation server module 28 specifies one modeling window as a processing target (S136), the window position management table is referred to, and a portion of the processing target window that is overlapped with another window on the front side thereof is referred to. All the areas except for are divided into several rectangular areas (S137).

  This will be described more specifically. FIG. 10 is a screen example of an operation screen in which windows registered in the window position management table 32 shown in FIG. 9 are shown. In this screen example, window B is a modeling window. It is also registered in the window management table 31 shown in FIG. Window A is displayed on the front side of window B, and a part thereof overlaps part of window B. And in the window B arrange | positioned in this way, the part which does not overlap with the window A is substantially concave shape. In such a specific example, the remote operation server module 28 performs processing for dividing the substantially concave portion into several rectangular regions. FIG. 11 is an explanatory diagram showing each rectangular area obtained by this division processing. As shown in FIG. 11, the remote operation server module 28 divides the substantially concave portion shown in the example of FIG. 10 into a portion on the right side of the window A (rectangular area Ba) and the window A. It is divided into a lower part (rectangular area Bb) and a left part of the window A (rectangular area Bc). FIG. 12 is a diagram showing position information (XY coordinate values at the upper left corner and XY coordinate values at the lower right corner) for the rectangular areas Ba to Bc divided by the division process.

  The remote operation server module 28 generates rectangular area position information as shown in FIG. 12 in the division process of step S137, and then uses the window ID and the rectangular area position information of this processing target window to perform RDP communication or ICA communication. The process of transmitting to the remote operation client module 18 of the web client device 10 is performed (S132). The processing performed when the remote operation client module 18 receives this window ID and rectangular area position information will be described later.

  After transmitting the window ID and the rectangular area position information, the remote operation server module 28 performs steps for all of the modeling windows that are partially hidden when the window indicated by the window content data is arranged on the front side. It is determined whether or not the processing of S137 and S138 has been completed (S139). If an unprocessed modeling window exists (S139; NO), one of the unprocessed modeling windows is processed. The target is specified, and Steps S137 and S138 are executed again.

  When the steps S137 and S138 have been executed for all the modeling windows (S139; YES), the remote operation server module 28 resumes the above processing loop (FIG. 4) (S106; NO, S107; NO, S108; NO).

  Next, the content of the part relevant to this invention among the processes performed in the web client apparatus 10 is demonstrated.

  The remote operation client module 18 of the web client device 10 is triggered by a request for establishing RDP communication or ICA communication by the remote operation server module 28 that executes step S102 of FIG. . FIG. 13 and FIG. 14 are diagrams showing the flow of processing executed by the CPU 11 in accordance with the remote operation client module 18.

  After starting the processing, the remote operation client module 18 (the CPU 11 according to the establishment) establishes communication with the remote operation server module 28 (S301), and then disconnects communication with the remote operation server module 28, generates an operation event, The system waits until an event other than an operation occurs or data is received from the remote operation server module 28 (S302; NO, S303; NO, S304; NO, S305; NO).

  Then, when such a processing loop (S302; NO, S303; NO, S304; NO, S305; NO) is being executed, there is a request for disconnecting communication from the remote operation server module 28 (S302; YES). ), The remote operation client module 18 ends the processes according to FIGS.

  Further, when a click, drag or key input operation event occurs during execution of the above processing loop (S302; NO, S303; NO, S304; NO, S305; NO) (S303; YES), the remote operation client The module 18 performs processing for transmitting operation event information indicating the operation event to the remote operation server module 28 through RDP communication or ICA communication (S306), and restarts the above processing loop (S302; NO, S303; NO, S304; NO, S305; NO).

  If an event other than an operation occurs during execution of the above processing loop (S302; NO, S303; NO, S304; NO, S305; NO) (S304; YES), the remote operation client module 18 Processing for transmitting information related to events other than operations to the remote operation server module 28 through RDP communication or ICA communication is performed (S307), and the above processing loop is resumed (S302; NO, S303; NO, S304; NO, S305; NO).

  Further, during the execution of the above processing loop (S302; NO, S303; NO, S304; NO, S305; NO), the remote operation server module 28 follows RDP communication or ICA communication or the above-mentioned original protocol. When data is received through communication (S305; YES), the remote operation client module 18 determines whether or not the received data is data including image data (S311).

  If the received data is data including image data (S311; YES), the remote operation client module 18 performs a process of displaying an image based on the image data in the area indicated by the position information included in the received data. (S312), the above processing loop is resumed (S302; NO, S303; NO, S304; NO, S305; NO).

  On the other hand, if the received data is not data including image data (S311; NO), the remote operation client module 18 determines whether or not the received data is data including a record transformed from the drawing command group to the transmission form. It discriminate | determines (S313).

  When the received data is data including a record transformed from the drawing command group to the transmission form (S313; YES), the remote operation client module 18 performs processing for restoring the drawing command group from the transmission data (S313: YES). S314).

  Subsequently, the remote operation client module 18 determines whether or not the drawing command group is a command group for drawing a CG in an unregistered window (S315).

  If this drawing command group is a command group for drawing a CG in an unregistered window (S315; YES), the remote operation client module 18 draws a three-dimensional model with the command group in that window. A graphic context that defines that is generated (S316), and the graphic context is registered in the window management table (S317). The data structure of this window management table is the same as that of the window management table shown in FIG. 7, and each record in this window management table has the same ID as the server-side window ID of FIG. Are recorded, and the storage location of the graphic context generated on the client side is recorded.

  After registering the graphic context in such a window management table, the remote operation client module 18 uses the window indicated by the window ID of the drawing command group as the CG drawing area, and displays the CG of the three-dimensional model according to the drawing command group. A drawing process is executed (S319). Thereafter, the remote operation client module 18 resumes the above processing loop (S302; NO, S303; NO, S304; NO, S305; NO).

  On the other hand, if this drawing command group is not a command group for drawing a CG in an unregistered window (S315; NO), the remote operation client module 18 does not perform a process of generating and registering a graphic context, A process of drawing the CG of the three-dimensional model according to the drawing command group is executed (S319), and the above processing loop is resumed (S302; NO, S303; NO, S304; NO, S305; NO).

  If the received data is not data including a record transformed from the drawing command group to the transmission form (S313; NO), since the received data is data including rectangular area position information, the remote operation client module 18 Performs a process of transforming the CG drawing area of the window indicated by the window ID included in the received data (S318). 10 and FIG. 11, the remote operation client module 18 has a rectangular shape among the CG drawing area (area of window B in FIG. 10) in the window indicated by the window ID included in the received data. The substantially concave portion consisting of the rectangular regions Ba, Bb, and Bc defined by the region position information is left, and the region other than that portion (the portion where the window A in FIG. 10 overlaps) is removed from the CG drawing region. .

  The remote operation client module 18 performs the process of deforming the CG drawing area, and then performs the process of drawing the CG of the three-dimensional model in the CG drawing area (S319), and restarts the above processing loop (S302). NO, S303; NO, S304; NO, S305; NO).

  Note that the CG drawing area in which the CG is drawn in step S319 is a screen including a transparent plane for detecting mouse input and key input, and a window B and window A for a three-dimensional model, as shown in FIG. It is on the CG drawing plane arranged between the application plane on which the image is displayed.

  Next, the operation and effect of the computer network system of this embodiment will be described.

  An operator of the web client device 10 specifies a URL including an execution instruction command for the CAD application 29 to remotely operate the CAD application 29 in the web application server device 20, and the web application server via the web browser 17. When the device 20 is accessed, an image of the screen for operating the CAD application 29 is displayed in the window for the web browser 17 (S101 to S105). As described above, a transparent plane for detecting mouse input and key input is arranged on the front side of the screen image, and the operator of the web client device 10 tries to operate the CAD application 29 to display the screen. If mouse input and key input are performed above, the contents of the operation event are transmitted to the CAD application 29 by the functions of the remote operation client module 18 and the remote operation server module 28, and the display contents change according to the operation event. The screen image after being displayed is displayed on the window for the web web browser (S303; YES, S306, S108; YES, S121 to S125). In this way, the CAD application 29 is remotely operated via the web browser.

  In order to create a 3D model (modeling) on the operation screen of the CAD application 29 displayed on the web client device 10 during the exchange of the operation event and the screen image data. Is instructed to open the window, the image data of the screen after drawing the CG of the 3D model in the window for the 3D model is transmitted from the web application server device 20 to the web client device 10. Instead, a drawing command for drawing the CG is transmitted to the web client device 10 (S303; YES, S306, S108; YES, S121, S122, S123; YES, S124, S125, S126; YES, S127, S128). In response to the drawing command, the web client device 10 draws the CG of the three-dimensional model using its own graphic accelerator (S305; YES, S311; NO, S313; YES, S314 to S317, S319).

  Therefore, according to the present embodiment, the process of drawing the CG of the three-dimensional model is not performed in the graphic accelerator of the web application server apparatus 20, but is performed in the graphic accelerator of the web client apparatus 10. The web client device 10 can draw a three-dimensional model CG at high speed.

  In addition, on the operation screen of the CAD application 29 displayed on the web client device 10, an instruction to display a window other than the modeling window (a GUI part such as a two-dimensional model creation (drafting) window or a drop-down list box) is displayed. Then, the image data of the image of the window is transmitted from the web application server device 20 to the web client device 10, and the window is displayed on the web client device 10 (S303; YES, S306, S108; YES). , S121, S122, S123; NO, S131, S132, S311; YES, S312,). At this time, when there is a modeling window that is partially hidden by displaying this window, the CG drawing area in the modeling window is deformed, and the CG of the 3D model is displayed in the hidden part. (S134; YES, S135; YES, S136-S139, S305; YES, S311; NO, S313; NO, S318). As a result, GUI parts such as a drafting window or a drop-down list box are displayed as if they were arranged on the front side of the modeling window. The CG is drawn at high speed by the graphic accelerator of the web client device 10.

(Appendix 1)
A web application system for remotely operating a modeling application in a web application server device in a web browser window of one or more web client devices,
The web application server device is
A screen transmission unit that receives a request from any of the web client devices and transmits screen image data for displaying an image of a screen for operating the modeling application to the web client device;
An operation receiving unit that receives, from the web client device, operation event information indicating an operation event made on the screen from the web client device;
When the operation event indicated by the operation event information received by the operation reception unit is made for a three-dimensional model to display CG on the screen, for rendering the CG from the modeling application A drawing command acquisition unit for acquiring a drawing command; and
A drawing command transmission unit that transmits the drawing command acquired by the drawing command acquisition unit to the web client device;
The web client device is
A request transmission unit that transmits a request to the web application server device when a request to remotely operate the modeling application is received from an operator in the input device;
When receiving the screen image data from the web application server device, a screen display unit that displays a screen based on the screen image data;
When an operation event made on the screen is detected, an operation transmission unit that transmits operation event information indicating the operation event to the web application server device,
When a drawing command is received from the web application server device, a CG drawing unit is provided for drawing a CG of a three-dimensional model based on the drawing command in a region in the screen where the CG of the three-dimensional model is to be drawn. Web application system.

(Appendix 2)
Computer
In response to a request from one or more web client devices connected via a communication device, screen image data for displaying a screen image for operating a modeling application is stored in the communication device. Screen transmission means for transmitting to the web client device via
Operation receiving means for receiving operation event information indicating an operation event made on the screen from the web client device from the web client device via the communication device;
When the operation event indicated by the operation event information received by the operation receiving means is for a three-dimensional model for displaying a CG on the screen, for rendering the CG from the modeling application A drawing command acquisition means for acquiring a drawing command; and
A remote operation server program that causes a drawing command acquired by the drawing command acquisition unit to function as a drawing command transmission unit that transmits the drawing command to the web client device via the communication device.

(Appendix 3)
Said computer further
When the operation event indicated by the operation event information received by the operation receiving means is an operation event of an operation other than the operation on the three-dimensional model to display CG on the screen, the operation is performed from the modeling application. Screen data acquisition means for acquiring screen data for displaying a screen after processing corresponding to an event is performed;
Screen image generation means for generating image data of a screen image indicated by the screen data acquired by the screen data acquisition means; and
The remote operation server program according to appendix 2, wherein the screen image data generated by the screen image generation unit is caused to function as a screen image transmission unit that transmits the screen image data to the web client device via the communication device.

(Appendix 4)
Said computer further
An area in which a 3D model is to be displayed when the operation event indicated by the operation event information received by the operation receiving means is an operation event of an operation other than an operation on the 3D model. Display area specifying means for specifying the remaining area other than the part as a CG drawing area of the three-dimensional model,
The remote operation according to appendix 2 or 3, wherein information specifying the CG drawing area specified by the display area specifying means is caused to function as a display area transmitting means for transmitting to the web client device via the communication device. Server program.

(Appendix 5)
The display area transmitting means divides the CG drawing area specified by the display area specifying means into several rectangular areas, and uses information regarding the position of each rectangular area as information defining a CG display area. The remote operation server program according to appendix 4, wherein the remote operation server program is transmitted to the web client device via the Internet.

(Appendix 6)
Computer
Request accepting means for accepting a request for remotely operating a modeling application of a web application server device connected via a communication device from an operator at the input device;
Request transmitting means for transmitting the request received by the request receiving means to the web application server device via the communication device;
Screen display means for displaying a screen on a display device based on the screen image data when the screen image data is received from the web application server device via the communication device;
When an operation event made on the screen is detected, operation transmission means for transmitting operation event information indicating the operation event to the web application server device via the communication device, and
When a drawing command is received from the web application server device via the communication device, a CG drawing of a three-dimensional model based on the drawing command is drawn in an area in the screen where the CG of the three-dimensional model is to be drawn. A remote operation client program characterized by functioning as a means.

The figure which shows the structure of the computer network system of this embodiment. The figure which shows the structure of a web client apparatus roughly The figure which shows the structure of a web application server apparatus roughly The figure which shows the flow of the process which CPU performs according to a remote control server module The figure which shows the flow of the process which CPU performs according to a remote control server module The figure which shows the flow of the process which CPU performs according to a remote control server module The figure which shows the flow of the process which CPU performs according to a remote control server module The figure which shows an example of the data structure of a window management table The figure which shows an example of the data structure of a window position management table Example screen showing the windows registered in the window position management table shown in FIG. Explanatory drawing which shows each rectangular area obtained by division processing The figure which shows the positional information (XY coordinate value of an upper left corner and XY coordinate value of a lower right corner) about the rectangular area divided | segmented by the division process The figure which shows the flow of the process which CPU performs according to a remote control client module The figure which shows the flow of the process which CPU performs according to a remote control client module Explanatory drawing which shows the relationship between a transparent plane, CG drawing plane, and an application plane

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Web client apparatus 10a Display apparatus 10b Input apparatus 10c Main body 11 CPU
12 DRAM
13 Communication adapter 15 HDD
17 Web browser 18 Remote operation client module 20 Web application server device 21 CPU
22 DRAM
23 Communication adapter 24 HDD
27 Web server program 28 Remote operation server module 29 CAD application

Claims (5)

A web application system for remotely operating a modeling application in a web application server device in a web browser window of one or more web client devices,
The web application server device is
A screen transmission unit that receives a request from any of the web client devices and transmits screen image data for displaying an image of a screen for operating the modeling application to the web client device;
An operation receiving unit that receives, from the web client device, operation event information indicating an operation event made on the screen from the web client device;
When the operation event indicated by the operation event information received by the operation reception unit is made for a three-dimensional model to display CG on the screen, for rendering the CG from the modeling application A drawing command acquisition unit for acquiring a drawing command; and
A drawing command transmission unit that transmits the drawing command acquired by the drawing command acquisition unit to the web client device;
The web client device is
A request transmission unit that transmits a request to the web application server device when a request to remotely operate the modeling application is received from an operator in the input device;
When receiving the screen image data from the web application server device, a screen display unit that displays a screen based on the screen image data;
When an operation event made on the screen is detected, an operation transmission unit that transmits operation event information indicating the operation event to the web application server device,
When a drawing command is received from the web application server device, a CG drawing unit is provided for drawing a CG of a three-dimensional model based on the drawing command in a region in the screen where the CG of the three-dimensional model is to be drawn. Web application system. Computer
In response to a request from one or more web client devices connected via a communication device, screen image data for displaying a screen image for operating a modeling application is stored in the communication device. Screen transmission means for transmitting to the web client device via
Operation receiving means for receiving operation event information indicating an operation event made on the screen from the web client device from the web client device via the communication device;
When the operation event indicated by the operation event information received by the operation receiving means is for a three-dimensional model for displaying a CG on the screen, for rendering the CG from the modeling application A drawing command acquisition means for acquiring a drawing command; and
A remote operation server program that causes a drawing command acquired by the drawing command acquisition unit to function as a drawing command transmission unit that transmits the drawing command to the web client device via the communication device. Said computer further
When the operation event indicated by the operation event information received by the operation receiving means is an operation event of an operation other than the operation on the three-dimensional model to display CG on the screen, the operation is performed from the modeling application. Screen data acquisition means for acquiring screen data for displaying a screen after processing corresponding to an event is performed;
Screen image generation means for generating image data of a screen image indicated by the screen data acquired by the screen data acquisition means; and
3. The remote operation server program according to claim 2, wherein the remote operation server program causes the screen image data generated by the screen image generation means to function as screen image transmission means for transmitting to the web client device via the communication device. Said computer further
An area in which a 3D model is to be displayed when the operation event indicated by the operation event information received by the operation receiving means is an operation event of an operation other than an operation on the 3D model. Display area specifying means for specifying the remaining area other than the part as a CG drawing area of the three-dimensional model,
4. The remote according to claim 2, wherein information defining the CG drawing area specified by the display area specifying means is caused to function as a display area transmitting means for transmitting to the web client device via the communication device. 5. Operation server program. Computer
Request accepting means for accepting a request for remotely operating a modeling application of a web application server device connected via a communication device from an operator at the input device;
Request transmitting means for transmitting the request received by the request receiving means to the web application server device via the communication device;
Screen display means for displaying a screen on a display device based on the screen image data when the screen image data is received from the web application server device via the communication device;
When an operation event made on the screen is detected, operation transmission means for transmitting operation event information indicating the operation event to the web application server device via the communication device, and
When a drawing command is received from the web application server device via the communication device, a CG drawing of a three-dimensional model based on the drawing command is drawn in an area in the screen where the CG of the three-dimensional model is to be drawn. A remote operation client program characterized by functioning as a means.