US20070168872A1 - Multi-monitor, multi-JVM java GUI infrastructure with layout via XML - Google Patents

Multi-monitor, multi-JVM java GUI infrastructure with layout via XML Download PDF

Info

Publication number
US20070168872A1
US20070168872A1 US11/334,432 US33443206A US2007168872A1 US 20070168872 A1 US20070168872 A1 US 20070168872A1 US 33443206 A US33443206 A US 33443206A US 2007168872 A1 US2007168872 A1 US 2007168872A1
Authority
US
United States
Prior art keywords
recited
monitors
computing system
gui
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/334,432
Inventor
Nicholas Almonte
William Stubbs
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Raytheon Co
Original Assignee
Raytheon Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Raytheon Co filed Critical Raytheon Co
Priority to US11/334,432 priority Critical patent/US20070168872A1/en
Assigned to RAYTHEON COMPANY reassignment RAYTHEON COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ALMONTE, NICHOLAS A., STUBBS, WILLIAM R.
Publication of US20070168872A1 publication Critical patent/US20070168872A1/en
Priority to US12/589,443 priority patent/US8863015B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Definitions

  • GUIs Java graphics user interfaces
  • MMW Multi-Modal Workstation
  • PC Personal Computer
  • Swing Java Graphics User Interfaces
  • SDK Java Software Development Kit
  • a graphics user interface GUI produced using Java Swing can have a “look and feel” which is either that of a Java platform, the native platform, or a particular specified platform.
  • the GUI can be constructed to display a Windows®-based format. (Windows is a registered trademark of Microsoft Corporation in the United States and other countries.)
  • Java virtual machine is an abstract computing machine that is responsible for hardware and operating system independence. As with a real computing machine, the JVM has an instruction set and it manipulates various areas of memory at run time. A hallmark of the JVM is its small compiled code and its ability to protect users from malicious computer programs. The JVM is aware of a particular binary format and class file format without knowing the particulars of the programming language. The JVM can host a language so long as it can be expressed as a valid class file. Typically, a single JVM runs as a single process on a physical computer, workstation, etc. having one or more monitors.
  • Java GUIs that run on multiple monitors use a single event queue and processing thread for all of the displays on all of the monitors.
  • Event handlers detect any action that a user takes while operating a GUI (each monitor provides a GUI). These actions include, but are not limited to, pressing a button, clicking a mouse, dragging or selecting a menu item, etc. Such actions will cause the JVM to handle (process) each singular event. As a result, no other event from the GUI in the MMW can be handled until processing of that single event is completed. Consequently, other parts of the GUI freeze while processing of the single event occurs.
  • GUIs cannot take advantage of multiple processors and therefore receive no performance enhancement if a multi-processor machine is used.
  • the GUI is composed using many hierarchical containers, including the top level JFrame container which produces a display region that can occupy up to a single monitor's total display surface area, and further including 1 to N (N being an integer) embedded JPanels which produce display regions each sized and laid out such that they can fill the display region produced by the JFrame container.
  • the container class and its subclasses are often referenced without distinction between the abstraction and the resulting display. Such will be the case herein. Consequently, for ease of description, the JFrame container and its subclasses will not always be distinguished from the display produced by the JFrame container.
  • the hierarchy of the GUI is flexible enough to permit containers within containers.
  • each JPanel Defined by each JPanel, and displayed within the display region produced by a JPanel, are all of the display regions created by the supported widgets such as buttons, menus, pull-downs, scroll bars, etc., which create these physical manifestations on-screen by the same name.
  • This hierarchy of containers and layouts along with complexity of managing them is made more difficult in the MMW system by the presence of multiple monitors.
  • Changing the layout in a Java Swing GUI requires recompilation of the software that describes the GUI layout.
  • the GUI display In applications, particularly ones in which an operator changes function or those where he/she has to switch from monitoring data to modifying data, the GUI display must likewise change as a result of changes in the GUI software. To do so using Java Swing, this requires that the GUI code be recompiled.
  • FIG. 2 illustrates a diagram of the Multi-Modal Workstation system.
  • FIG. 3 graphically depicts the functional diagram of the DisplaySurfaceController.
  • FIG. 4 is a diagram illustrating an embodiment of the invention depicting an MMW system flow where the display of one monitor's display is initialized.
  • Event handling problems of the Java Swing single event queue are resolved, according to one embodiment of the invention, by using multiple JVMs in the MMW. Since the Java language does not allow custom or multiple Swing event queues within the same JVM, one way to get a separate event queue in a GUI is to use a separate JVM for each GUI. Additionally, using multiple JVMs removes the performance limitation of the “single event queue for an entire MMW” model by instead providing an event queue for each GUI. This approach is applicable for use with other languages other than Java which define a single event queue with respect to a GUI.
  • FIG. 1 illustrates a diagram of a GUI infrastructure used in a MMW having multiple monitors (i.e., displays).
  • Monitors 132 subscripted from 1 to N, (N being an integer), Jframe 134 , and Jpanel 136 .
  • one JVM 102 (also subscripted from 1 to N) is provided for each monitor supported by the MMW.
  • Each display surface 104 is governed by a DisplaySurfaceController 126 , a class that configures the display surface (arranges panels, pull down menus, buttons, etc.), manages displayed GUIComponents 138 , and disperses events to the GUIComponents 138 it has loaded.
  • DisplaySurfaceController 126 controls the configuration of a monitor associated with a particular JVM.
  • GUIComponents 138 are classes that implement the GUIComponentInterface (not shown).
  • the GUIComponentInterface specifies a set of operations that all displays have to provide to in order to work with this GUI infrastructure.
  • the MMW is implemented by creating abstract constructs and instantiations of the GUI panels (i.e., creating GUI objects). Data is shared and passed throughout the overall GUI. It is not assumed that a particular GUIComponent 138 , as embodied by the present invention, is local with respect to another GUIComponent 138 .
  • the location (JVM, Monitor) of any particular GUIComponent is specified in the GUIConfig XML file 122 read by LocalDisplayServer 112 at startup.
  • LocalDisplayServer 112 is a class that controls access to GUIConfig XML file 122 and distributes event and configuration information to the other JVMs in the MMW system.
  • the configuration chosen by LocalDisplayServer 112 is passed to each DisplaySurfaceController 126 allowing it to set-up communication links to each of the other DisplaySurfaceControllers 126 and LocalDisplayServers 112 .
  • the DisplaySurfaceController 126 is a class that controls the configuration of the monitor associated with a specific JVM.
  • a helper class called Connector 160 handles the communications links. Connector 160 hides whether a communication link is to a remote JVM 102 or simply a reference to another “local” connector 160 in the same JVM 102 . This allows GUIComponents to send and receive GUIEvents without ever needing to know how the GUIEvent actually is transported.
  • JAR file 170 enables the bundling of multiple files into a single archive file. It offers the following advantages:
  • GUIEvent is a serializable base class that specific events extend to add their own fields while maintaining the ability for the class to be serialized and sent from one JVM to another. Communication is contemplated over various media including digital wireless systems, satellite systems, the Internet (e.g. using TCP/IP), the public switched telephone network (PSTN), public data switching network (e.g., ATM and SONET) (PDSN) etc.
  • the location of an individual panel of a GUI, its associated JVM, the number of JVMs in use, the number of monitors in use or its location in the MMW (monitor location, pixel range, etc) are not defined until runtime of the software that describes the GUI layout.
  • this GUI infrastructure it is possible to construct a GUI containing panels whose location on a specific monitor or any number of monitors is defined at runtime with a separate event queue for each display surface.
  • performance problems in one panel of the GUI are isolated to it's JVM only, allowing the other GUI panels of the other display surfaces and their associated JVMs to remain responsive and functional.
  • GUI software runs in the background of a display application. When screen buttons are pushed, pull-down menus selected, etc., these actions are treated as events in event driven software, such as Java Swing.
  • GUI layouts are defined in an Extensible Markup Language (XML) file 150 maintained in persistent storage 152 .
  • Persistent storage 152 can represent the hard drive of a workstation, a database, or information received from a network from a remote server.
  • changes to the layout of GUI panels and other features of a display surface are accomplished by altering XML file 150 .
  • GUI software defining a display layout need only access or load XML file 150 to implement a change in the display layout.
  • GUI layouts in an XML file obviates the need to modify code and recompile software that describes the GUI layout when changes in the GUI layout are required. Once the change has been implemented, the GUI software need only be re-launched, rather than modified and recompiled as is the case with the what now represents the prior art and a more complicated and time consuming requirement.
  • the layouts of the panels supporting multiple operator roles on the MMW become much easier to manage as the unique layout for each role is now maintained in an XML file and not hard-coded in GUI software.
  • XML file 150 is parsed by a JVM upon startup of a GUI.
  • one of the JVMs can be chosen on the basis of which one is the first to be placed in operation. Accordingly, panels are organized across all of the available monitors appropriately.
  • XML file 150 will list the number of screens to be used, which screen a particular panel will be located on, and the exact size and location of each panel.

Abstract

A method and system are provided which allows enhanced support to graphical user interface (GUI) displays on multiple monitors. An extended markup language file provides code to configure each GUI. GUI software need not be re-compiled in order to implement changes in the layout of displays or to accommodate additional monitors. Potential display event handling delays are minimized by providing multiple Java Virtual Machines (JVMs)for GUIs. In one aspect, one JVM is provided for each GUI.

Description

    BACKGROUND
  • The creation of Java graphics user interfaces (GUIs) (Java is a registered trademark of Sun®) that support a Multi-Modal Workstation (MMW), UNIX workstation or Personal Computer (PC), (all generally referenced herein as a MMW) having one or more monitors, is currently implemented with the Java Swing package. When Java was originally created, only the Abstract Windows Toolkit (AWT) library was available for working with graphics. This package contains a simple set of classes such as Buttons, TextField, Label and others. A more advanced set of classes is contained in the later introduced library called Swing. Swing, like AWT, is a package that also includes buttons, text fields, and other classes for providing window controls. Swing allows GUIs to be built using the Java Software Development Kit (SDK). The names of the Swing components start with the letter J, for example, JButton, JTextField, JLabel, and so on. A graphics user interface GUI produced using Java Swing can have a “look and feel” which is either that of a Java platform, the native platform, or a particular specified platform. For instance, the GUI can be constructed to display a Windows®-based format. (Windows is a registered trademark of Microsoft Corporation in the United States and other countries.)
  • A Java virtual machine (JVM) is an abstract computing machine that is responsible for hardware and operating system independence. As with a real computing machine, the JVM has an instruction set and it manipulates various areas of memory at run time. A hallmark of the JVM is its small compiled code and its ability to protect users from malicious computer programs. The JVM is aware of a particular binary format and class file format without knowing the particulars of the programming language. The JVM can host a language so long as it can be expressed as a valid class file. Typically, a single JVM runs as a single process on a physical computer, workstation, etc. having one or more monitors.
  • Java GUIs that run on multiple monitors use a single event queue and processing thread for all of the displays on all of the monitors. Event handlers detect any action that a user takes while operating a GUI (each monitor provides a GUI). These actions include, but are not limited to, pressing a button, clicking a mouse, dragging or selecting a menu item, etc. Such actions will cause the JVM to handle (process) each singular event. As a result, no other event from the GUI in the MMW can be handled until processing of that single event is completed. Consequently, other parts of the GUI freeze while processing of the single event occurs.
  • The “freezing” of the GUI on MMW monitors in a system while an event handler is processing an event on a particular part of the GUI is a serious limitation presented by Java Swing for MMWs. To overcome this problem, spawning another thread to process potentially slow event handling code does not solve two large problems: namely, (1) all display updates must be done on the event queue thread, causing graphic intensive processes to still freeze all of the GUIs across all monitors; and (2) use of multiple threads cannot generally be applied to third party commercial-of-the-shelf (COTS) software products that may be integrated into the GUI. Developers usually have no knowledge of how COTS software is written.
  • In addition to the freezing of GUIs, another problem with Java Swing's single threaded nature is that GUIs cannot take advantage of multiple processors and therefore receive no performance enhancement if a multi-processor machine is used.
  • In MMW applications, the GUI is composed using many hierarchical containers, including the top level JFrame container which produces a display region that can occupy up to a single monitor's total display surface area, and further including 1 to N (N being an integer) embedded JPanels which produce display regions each sized and laid out such that they can fill the display region produced by the JFrame container. The container class and its subclasses are often referenced without distinction between the abstraction and the resulting display. Such will be the case herein. Consequently, for ease of description, the JFrame container and its subclasses will not always be distinguished from the display produced by the JFrame container. The hierarchy of the GUI is flexible enough to permit containers within containers. Defined by each JPanel, and displayed within the display region produced by a JPanel, are all of the display regions created by the supported widgets such as buttons, menus, pull-downs, scroll bars, etc., which create these physical manifestations on-screen by the same name. This hierarchy of containers and layouts along with complexity of managing them is made more difficult in the MMW system by the presence of multiple monitors.
  • Another requirement for MMW systems is the ability to dynamically change GUI displays. Evolving task requirements and rapid prototyping both require an easy to alter GUI layout despite the multiple display requirements of the MMW.
  • Changing the layout in a Java Swing GUI requires recompilation of the software that describes the GUI layout. In applications, particularly ones in which an operator changes function or those where he/she has to switch from monitoring data to modifying data, the GUI display must likewise change as a result of changes in the GUI software. To do so using Java Swing, this requires that the GUI code be recompiled.
  • A need exists to resolve the freezing and rigid GUI design problems that arise in MMW GUI systems. Until now, no adequate solution existed.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagram illustrating the GUI infrastructure for an MMW used in one embodiment of the invention to ground-truth document images in accordance with an embodiment of the present invention.
  • FIG. 2 illustrates a diagram of the Multi-Modal Workstation system.
  • FIG. 3 graphically depicts the functional diagram of the DisplaySurfaceController.
  • FIG. 4 is a diagram illustrating an embodiment of the invention depicting an MMW system flow where the display of one monitor's display is initialized.
  • Applicable reference numerals have been carried forward.
  • DETAILED DESCRIPTION
  • Event handling problems of the Java Swing single event queue are resolved, according to one embodiment of the invention, by using multiple JVMs in the MMW. Since the Java language does not allow custom or multiple Swing event queues within the same JVM, one way to get a separate event queue in a GUI is to use a separate JVM for each GUI. Additionally, using multiple JVMs removes the performance limitation of the “single event queue for an entire MMW” model by instead providing an event queue for each GUI. This approach is applicable for use with other languages other than Java which define a single event queue with respect to a GUI.
  • FIG. 1 illustrates a diagram of a GUI infrastructure used in a MMW having multiple monitors (i.e., displays). The hierarchical relationship of the containers are illustrated as described above with respect to Monitors 132 subscripted from 1 to N, (N being an integer), Jframe 134, and Jpanel 136. In one embodiment of the invention, one JVM 102 (also subscripted from 1 to N) is provided for each monitor supported by the MMW. Each display surface 104 is governed by a DisplaySurfaceController 126, a class that configures the display surface (arranges panels, pull down menus, buttons, etc.), manages displayed GUIComponents 138, and disperses events to the GUIComponents 138 it has loaded. DisplaySurfaceController 126, in essence, controls the configuration of a monitor associated with a particular JVM. GUIComponents 138 are classes that implement the GUIComponentInterface (not shown). The GUIComponentInterface specifies a set of operations that all displays have to provide to in order to work with this GUI infrastructure.
  • In one aspect of the invention, the MMW is implemented by creating abstract constructs and instantiations of the GUI panels (i.e., creating GUI objects). Data is shared and passed throughout the overall GUI. It is not assumed that a particular GUIComponent 138, as embodied by the present invention, is local with respect to another GUIComponent 138. The location (JVM, Monitor) of any particular GUIComponent is specified in the GUIConfig XML file 122 read by LocalDisplayServer 112 at startup. LocalDisplayServer 112 is a class that controls access to GUIConfig XML file 122 and distributes event and configuration information to the other JVMs in the MMW system. The configuration chosen by LocalDisplayServer 112 is passed to each DisplaySurfaceController 126 allowing it to set-up communication links to each of the other DisplaySurfaceControllers 126 and LocalDisplayServers 112. The DisplaySurfaceController 126 is a class that controls the configuration of the monitor associated with a specific JVM. A helper class called Connector 160 handles the communications links. Connector 160 hides whether a communication link is to a remote JVM 102 or simply a reference to another “local” connector 160 in the same JVM 102. This allows GUIComponents to send and receive GUIEvents without ever needing to know how the GUIEvent actually is transported. In one embodiment of the invention, connector 160, local display server 112, display surface controller 126 and GUIComponent 138 are maintained in JAR file 170. JAR file 170 enables the bundling of multiple files into a single archive file. It offers the following advantages:
      • A) Contents of the JAR file can be digitally signed, allowing recognition of the signature and a grant of software security privileges based on the signature by users.
      • B) The class files and associated resources of a JAVA applet bundled in the JAR file can be downloaded to a browser in a single HTTP transaction without the need open a new connection for each file.
      • C) The JAR format allows compression of files contained therein for efficient storage.
      • D) JAR file formats allow adding extensions for software.
      • E) Packages stored in JAR files can be sealed, meaning that all classes defined in a package are found in the same JAR file.
      • F) Information pertaining to software vendor and version can be held in a JAR file.
      • G) JAR files are a standard part to the JAVA platform's core API.
  • All communication i.e. data, commands, etc. between GUIComponents must be packaged in the form of a GUIEvent. The GUIEvent is a serializable base class that specific events extend to add their own fields while maintaining the ability for the class to be serialized and sent from one JVM to another. Communication is contemplated over various media including digital wireless systems, satellite systems, the Internet (e.g. using TCP/IP), the public switched telephone network (PSTN), public data switching network (e.g., ATM and SONET) (PDSN) etc. Consequently, according to one aspect of the invention, the location of an individual panel of a GUI, its associated JVM, the number of JVMs in use, the number of monitors in use or its location in the MMW (monitor location, pixel range, etc) are not defined until runtime of the software that describes the GUI layout. Moreover, with this GUI infrastructure in place, it is possible to construct a GUI containing panels whose location on a specific monitor or any number of monitors is defined at runtime with a separate event queue for each display surface. As a result, performance problems in one panel of the GUI are isolated to it's JVM only, allowing the other GUI panels of the other display surfaces and their associated JVMs to remain responsive and functional.
  • GUI software runs in the background of a display application. When screen buttons are pushed, pull-down menus selected, etc., these actions are treated as events in event driven software, such as Java Swing. With reference still to FIG. 1, in an aspect of the invention, GUI layouts are defined in an Extensible Markup Language (XML) file 150 maintained in persistent storage 152. Persistent storage 152 can represent the hard drive of a workstation, a database, or information received from a network from a remote server. In another aspect of the present invention, changes to the layout of GUI panels and other features of a display surface are accomplished by altering XML file 150. GUI software defining a display layout need only access or load XML file 150 to implement a change in the display layout. Defining GUI layouts in an XML file obviates the need to modify code and recompile software that describes the GUI layout when changes in the GUI layout are required. Once the change has been implemented, the GUI software need only be re-launched, rather than modified and recompiled as is the case with the what now represents the prior art and a more complicated and time consuming requirement. In addition, with each panels' location attributes described in an XML file, the layouts of the panels supporting multiple operator roles on the MMW become much easier to manage as the unique layout for each role is now maintained in an XML file and not hard-coded in GUI software. Pursuant to one of many possible schemes, XML file 150 is parsed by a JVM upon startup of a GUI. For instance, one of the JVMs can be chosen on the basis of which one is the first to be placed in operation. Accordingly, panels are organized across all of the available monitors appropriately. XML file 150 will list the number of screens to be used, which screen a particular panel will be located on, and the exact size and location of each panel.
  • The combination of panels laid out and organized according to that specified in an XML file together with a GUI infrastructure that supports multiple JVMs, thus eliminating the single Swing event queue problem of the Java GUI development or other similarly disposed programs, provides, in comparison with conventional systems, a multi-monitor display solution which requires less compilation time and more flexible support of different layouts required by various operator roles supported by a MMW system.
  • FIG. 2 illustrates a graphical representation of one embodiment of the invention showing the one workstation used to create the multiple JVMs. In this embodiment of the invention, the GUIConfig XML file can be resident in the permanent storage of the workstation or exist independently and reside in a remote location connected to the MMW by a communication link. In addition, FIG. 2 depicts up to N monitors supported by this embodiment of the invention.
  • FIG. 3 is a diagram which details one embodiment of DisplaySurfaceController 126, which is responsible for loading and layout of panels for its display surface. DisplaySurfaceController 126 accomplishes this task through the use of two helper classes: RoleLayoutManager 304 and PanelFactory 302. RoleLayoutManager 304 selects the appropriate panel layout for the role as specified in the XML file (GUIConfig XML file 122) defining a class specifying the GUI configuration for the specific display based on the number of monitors selected by LocalDisplayServer 112 (shown in FIG. 1) at startup. RoleLayoutManager 304 causes each GUIComponent 138 to add itself to an empty JPanel 310 that RoleLayoutManager 304 has created, located and sized based on the layout specified in the GUIConfig XML file 122 for the specific GUIComponent 308. By having the GUIComponent 308 add itself to the newly created empty JPanel 136 allows the GUIComponent 138 to perform any necessary internal resizing or look and feel change based on the size or position of where it will be displayed.
  • Role switches are performed by moving all of the currently loaded GUIComponents 138 to a cache (not shown). As the new role's layout is created, the cache is checked for an already constructed GUIComponent of a specific type before a new layout is loaded. After the role switch is complete, all GUIComponents 138 left in the cache are asked to un-register for events and then are destroyed by the JVM Garbage Collector (not shown). The JVM Garbage Collector is a package provided by the Java SDK. By using the caching mechanism, GUIComponents that are common to multiple roles do not have to be reloaded every time a role switch occurs.
  • FIG. 4 is a diagram illustrating a framework, according to the invention, with respect to Monitors 1 through MonitorsM (M representing the index of the JVM). During startup, LocalDisplayServer 112 loads GUIConfig XML 122. LocalDisplayServer 112 starts the number of JVMs specified in GUIConfig XML 122 and instantiates DisplaySurfaceController 126 in the JVM for each display surface specified in the XML. The configuration and GUI layout chosen by the LocalDisplayServer 112 is passed to each DisplaySurfaceController 126. This configuration allows the DisplaySurfaceController 126 to set up communication links with each of the other DisplaySurfaceControllers 126 and LocalDisplayServer 112. A helper class called Connector 160 handles all internal JVM and external JVM communication links, indicated by double arrow 176. All incoming and outgoing GUIEvents pass through the Connector 160. GUIComponents 308 have access to Connector 160 via DisplaySurfaceController 126, indicated by double arrow 175. DisplaySurfaceController 126 creates JPanels 136 according to the GUI Layout provided by LocalDisplayServer 112.
  • The foregoing invention has many applications, particularly in the fast paced world of commodities trading. For instance, traders could be provided with monitors that would display up-to-date information on selected commodities. One or more such monitors could be provided access to information allowing input for selecting call or put options based on feedback from the market. A multi-monitor, multi JVM system would offers increased flexibility and lower operational cost as compared with current systems. Another application within the existing infrastructure of the Internet, would be to provide a workstation for presenting data across boundaries defined by language or nation. Consequently, each monitor is the system could present rapidly changing market information while uniquely being configured according to language and/or presentation requirements.
  • The foregoing multi-monitor, multi-JVM system additionally has far ranging applications to gaming, particularly video gaming. One gaming application exists for a game requiring a coherent display across a multiple monitors. This includes, for example, games presenting a view into a virtual world. These games could leverage the power of multiple machines with separate monitors. The multi-monitor, mult-JVM system can provide its users multiple and different views of the virtual world simultaneously as a coherent display across all of the users' monitors, while still allowing an individual user to maintain control from a single point. This offers low operational cost and flexibility as compared with competing systems. This application is particularly well suited for use with games and gaming systems where players require a number of different views simultaneously and where they must act upon the information presented.
  • Yet another application for the multi-monitor, multi-JVM system according to the invention applies to the banking, lending and real estate industries. While perhaps not needing information at a rate as fast as the commodities industries, one implementation for the invention would be to provide multiple monitors presenting simultaneous streams of information. For example, lending offers could adjust loan rates to compete with products from banks or institutions where insurance, home mortgages or certificates of deposit (CDs) are sold using monitors displaying this information within a system according to the invention. In addition, applications of this sort can also be provided in a closed environment offering security with controlled access to important data-a vital component of financial systems.
  • The foregoing invention is also well-suited for offering displays tailored to a particular language. A MMW according to the invention can easily support, for instance, several multi-monitor GUIs, each having displays according to different languages, e.g. English, Swedish, Russian, German, Japanese, Chinese, etc.
  • Although the invention herein has been described with reference to particular embodiments, it is to be understood that these embodiments are merely illustrative of the principles and applications of the present invention. For instance, Microsoft®'s C Sharp is contemplated as a programming language for use with the invention. It is therefore to be understood that numerous modifications may be made to the illustrative embodiments and that other arrangements may be devised without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims (27)

1. A computing system comprising:
a plurality of monitors;
a computer programmed with a file that includes graphic user display information for configuration of visual content on said plurality of monitors.
2. A computing system as recited in claim 1 wherein said computer comprises a workstation.
3. A computing system as recited in claim 1 wherein said computer comprises a multi-modal workstation.
4. A computing system as recited in claim 3 wherein said file is an extended markup language (XML) file.
5. A computing system as recited in claim 3 wherein said computer is programmed according a language selected from the Java and C Sharp.
6. A computing system as recited in claim 3 wherein more than one Java Virtual Machine (JVM) is programmed for use with said plurality of monitors.
7. A computing system as recited in claim 6 wherein a one-to-one correspondence exist between Java Virtual Machines and monitors.
8. A computing system as recited in claim 4 wherein said XML file defines a layout of a plurality of GUIs, each GUI associated with a monitor and said GUIs being capable of operating independently from one another.
9. A computing system as recited in claim 4 wherein said XML file is comprised of GUI layout information and is capable of being changed without the need to re-compile Multi-Monitor Multi-JVM Java GUI code in connection with GUI layout modifications to said system.
10. A computing system as recited in claim 3 wherein said workstation may be a multiprocessor workstation.
11. A computing system as recited in claim 9 wherein said XML file defines the number of JVMs to be started by said system.
12. A multi-modal computing system comprising:
a computer programmed to implement a plurality of Java Virtual Machines (JVMs), said plurality of JVMs defining a plurality of graphical user interfaces (GUIs) for use with a plurality of monitors.
13. A multi-modal computing system as recited in claim 12 wherein a maximum of one JVM hosts the GUI on a single monitor.
14. A multi-modal computing system as recited in claim 12 wherein said computer comprises a workstation.
15. A multi-modal computing system as recited in claim 12 wherein said computer is further programmed to include an XML file for configuring said GUIs.
16. A multi-modal computing system as recited in claim 12 wherein said plurality of JVMs provide event handling in connection with each monitor from said plurality of monitors.
17. A multi-modal computing system as recited in claim 15 wherein said plurality of JVMs provide event handling in connection with each monitor from said plurality of monitors.
18. A method of supporting multiple displays by a multi-modal computing system comprising:
providing a GUI configuration file for a computer used in connection with a workstation providing selected graphical user displays to a plurality of monitors; and
parsing said file in connection with providing GUIs on said monitors.
19. A method of supporting multiple displays as recited in claim 18 further providing a plurality of JVMs for said plurality of monitors.
20. A method of supporting multiple displays as recited in claim 19 further including providing event handling in each JVM.
21. A method of supporting multiple displays as recited in claim 19 wherein JVMs are provided to monitors on a maximum one-to-one basis.
22. A method of supporting multiple displays as recited in claim 18 wherein said file consists of an XML file that may be parsed by a Java or C-Sharp implementation.
23. A method of supporting multiple displays as recited in claim 20 wherein said file consists of an XML file that may be parsed by a Java or C-Sharp implementation.
24. A method of supporting multiple displays as recited in claim 19 wherein commodities trading is conducted by updating display information on said plurality of monitors in connection with feedback from commodities market activity.
25. A method as recited in claim 24 wherein said monitors display information according to a language of choice.
26. A method as recited in claim 19 wherein gaming is conducted by updating display information on said plurality of monitors in connection with feedback from gaming activity, each monitor reflecting the display preferences of an associated gamer.
27. A method as recited in claim 19 wherein business, selected from the group consisting of banking, lending and real estate, is conducted wherein display information is updated based on feedback from activity in an associated market.
US11/334,432 2006-01-19 2006-01-19 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML Abandoned US20070168872A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US11/334,432 US20070168872A1 (en) 2006-01-19 2006-01-19 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML
US12/589,443 US8863015B2 (en) 2006-01-19 2009-10-23 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11/334,432 US20070168872A1 (en) 2006-01-19 2006-01-19 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/589,443 Continuation US8863015B2 (en) 2006-01-19 2009-10-23 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML

Publications (1)

Publication Number Publication Date
US20070168872A1 true US20070168872A1 (en) 2007-07-19

Family

ID=38264758

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/334,432 Abandoned US20070168872A1 (en) 2006-01-19 2006-01-19 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML
US12/589,443 Active 2027-05-08 US8863015B2 (en) 2006-01-19 2009-10-23 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12/589,443 Active 2027-05-08 US8863015B2 (en) 2006-01-19 2009-10-23 Multi-monitor, multi-JVM java GUI infrastructure with layout via XML

Country Status (1)

Country Link
US (2) US20070168872A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070174784A1 (en) * 2006-01-26 2007-07-26 Tangtake Technology Co., Ltd. Method for presenting objects of the windows operating environment on multiple display devices
US20100064251A1 (en) * 2008-09-05 2010-03-11 International Business Machines Corporation Toggling window display state by screen in a multi-screened desktop environment
CN103777966A (en) * 2014-02-28 2014-05-07 广州视源电子科技股份有限公司 Method and device for extracting code information from binary file
CN107544805A (en) * 2017-09-04 2018-01-05 同济大学 Mobile phone games system architecture based on android system reusable framework
US10951661B1 (en) * 2018-05-08 2021-03-16 Amazon Technologies, Inc. Secure programming interface hierarchies
US11500604B2 (en) * 2011-06-30 2022-11-15 International Business Machines Corporation Presenting a document on a computer

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070168872A1 (en) * 2006-01-19 2007-07-19 Raytheon Company Multi-monitor, multi-JVM java GUI infrastructure with layout via XML
GB0610946D0 (en) * 2006-06-02 2006-07-12 Vida Software S L User interfaces for electronic devices
US9110790B1 (en) * 2008-06-30 2015-08-18 Emc Corporation Managing memory in displaying data storage system information
US8656361B2 (en) * 2012-02-06 2014-02-18 Microsoft Corporation Debugging code visually on a canvas
US9311169B2 (en) * 2012-05-02 2016-04-12 Nvidia Corporation Server based graphics processing techniques
US20150264423A1 (en) * 2014-03-11 2015-09-17 Telefonaktiebolaget L M Ericsson (Publ) Methods and systems for dynamic runtime generation of customized applications
US9432734B2 (en) 2014-09-10 2016-08-30 Telefonaktiebolaget L M Ericsson (Publ) Multi-person and multi-device content personalization
US10963539B2 (en) 2014-09-10 2021-03-30 Mk Systems Usa Inc. Interactive web application editor
US10203947B2 (en) * 2016-08-03 2019-02-12 Toyota Infotechnology Center Usa, Inc. Efficient over-the-air software update for a connected vehicle
CN107870798A (en) * 2017-09-26 2018-04-03 五八有限公司 The page layout processing method and terminal of application program
US10638022B2 (en) 2018-09-07 2020-04-28 Tribune Broadcasting Company, Llc Multi-panel display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040044953A1 (en) * 2000-11-18 2004-03-04 Andrew Watkins Resource files for electronic devices
US6717596B1 (en) * 2000-02-18 2004-04-06 Xsides Corporation Method and system for controlling a complementary user interface on a display surface
US20040226041A1 (en) * 2000-02-18 2004-11-11 Xsides Corporation System and method for parallel data display of multiple executing environments
US20050015307A1 (en) * 2003-04-28 2005-01-20 Simpson Todd Garrett Method and system of providing location sensitive business information to customers
US20050039183A1 (en) * 2000-01-28 2005-02-17 Francisco Romero System and method for allocating a plurality of resources between a plurality of computing domains

Family Cites Families (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4835685A (en) * 1985-05-06 1989-05-30 Computer X, Inc. Virtual single machine with message-like hardware interrupts and processor exceptions
US4694396A (en) * 1985-05-06 1987-09-15 Computer X, Inc. Method of inter-process communication in a distributed data processing system
US4754395A (en) * 1985-05-06 1988-06-28 Computer X, Inc. Network interface module with minimized data paths
US5047925A (en) * 1985-05-06 1991-09-10 Motorola, Inc. Logical ring in a virtual single machine
US4787026A (en) * 1986-01-17 1988-11-22 International Business Machines Corporation Method to manage coprocessor in a virtual memory virtual machine data processing system
US4914583A (en) * 1988-04-13 1990-04-03 Motorola, Inc. Method of indicating processes resident within a cell of a data processing system
US5109486A (en) * 1989-01-06 1992-04-28 Motorola, Inc. Distributed computer system with network and resource status monitoring
JP2778798B2 (en) * 1990-04-11 1998-07-23 富士通株式会社 Queue structure management processing method for control data
US6262695B1 (en) * 1997-11-18 2001-07-17 Tridium Research, Inc. Method and apparatus for phase-locking a plurality of display devices and multi-level driver for use therewith
US6108687A (en) * 1998-03-02 2000-08-22 Hewlett Packard Company System and method for providing a synchronized display to a plurality of computers over a global computer network
US20020030635A1 (en) * 1998-11-16 2002-03-14 Mcgowan Scott J. Method and apparatus for phase-locking a plurality of display devices and multi-level driver for use therewith
US6266056B1 (en) * 1998-11-30 2001-07-24 Sun Microsystems, Inc. Display widget interaction in embedded systems using child graphics contexts
US6351272B1 (en) * 1998-11-30 2002-02-26 Sun Microsystems, Inc. Applet and application display in embedded systems using child and orphan graphics contexts
EP1011042B1 (en) * 1998-11-30 2006-10-25 Sun Microsystems, Inc. Applet and application display in embedded systems using bufferless child graphics contexts
US6407759B1 (en) * 1998-11-30 2002-06-18 Sun Microsystems, Inc. Method and apparatus for modal dialog box management in applets on information appliances
US7216300B2 (en) * 1998-12-30 2007-05-08 Ncr Corp. Method and apparatus for an applet to display multiple windows
US6543011B1 (en) * 1999-07-15 2003-04-01 International Business Machines Corporation Method for event recording in java
AU1934901A (en) * 1999-11-30 2001-06-12 Sun Microsystems, Inc. Apparatus and methods for communicating between resource domains
US20020120547A1 (en) * 2000-12-18 2002-08-29 Paul Zajac Method and system for administering a multi-interface system
US20020120546A1 (en) * 2000-12-18 2002-08-29 Paul Zajac Mutli-interface financial transaction system and method
US20030041000A1 (en) * 2000-12-18 2003-02-27 Paul Zajac System and method for providing a graphical user interface for a multi-interface financial transaction system
US7596791B2 (en) * 2000-12-19 2009-09-29 Emc Corporation Methods and techniques for delivering rich Java applications over thin-wire connections with high performance and scalability
US7146602B2 (en) * 2001-01-16 2006-12-05 Ajile Systems, Inc. Builder tool and interface for system supporting multiple virtual machines
US7113904B2 (en) * 2001-03-30 2006-09-26 Park City Group System and method for providing dynamic multiple language support for application programs
US7519546B2 (en) * 2001-04-30 2009-04-14 General Electric Company Maintaining synchronization of information published to multiple subscribers
US20030046441A1 (en) * 2001-07-05 2003-03-06 Rau Sadhana S. Teamware repository of teamware workspaces
AU2002351911A1 (en) * 2001-11-07 2003-05-19 Harald Kuck Providing isolation through process attachable virtual machines
EP1333386A1 (en) * 2002-01-08 2003-08-06 Sap Ag Providing web page for executing tasks by user, with data object
US7007158B1 (en) * 2002-02-14 2006-02-28 Adaptec, Inc. Method for providing a configuration extensible markup language (XML) page to a user for configuring an XML based storage handling controller
US7987491B2 (en) * 2002-05-10 2011-07-26 Richard Reisman Method and apparatus for browsing using alternative linkbases
US7130408B2 (en) * 2002-06-14 2006-10-31 International Business Machines Corporation Service logic context cache for signaling events
US7085821B2 (en) * 2002-06-14 2006-08-01 International Business Machines Corporation TCAP event processing environment
GB0213688D0 (en) * 2002-06-14 2002-07-24 Ibm Automated test generation
US7111303B2 (en) * 2002-07-16 2006-09-19 International Business Machines Corporation Virtual machine operating system LAN
US20050065951A1 (en) * 2002-08-30 2005-03-24 Kathleen Liston Visualization of commonalities in data from different sources
JP4764631B2 (en) * 2002-10-10 2011-09-07 パナソニック株式会社 Optical disc, playback device, program, playback method, recording method
US7441233B1 (en) * 2002-12-20 2008-10-21 Borland Software Corporation System and method providing status indication for long-running modal tasks
US20040150649A1 (en) * 2003-01-30 2004-08-05 Jerry Moscovitch Method and apparatus for matching multiple displays in a multi-display environment
US7356818B2 (en) * 2003-06-24 2008-04-08 International Business Machines Corporation Virtual machine communicating to external device without going through other virtual machines by using a list of IP addresses managed only by a single virtual machine monitor
US7469346B2 (en) * 2003-06-27 2008-12-23 Disney Enterprises, Inc. Dual virtual machine architecture for media devices
WO2005057401A1 (en) * 2003-12-05 2005-06-23 Parera Nunez Jorge Multi-screen computer
US7613600B2 (en) * 2003-12-24 2009-11-03 Sap Ag Unified personalization
US7904904B2 (en) * 2004-02-18 2011-03-08 Oracle America, Inc. Processing events for concurrent tasks in a virtual machine
US7644407B2 (en) * 2004-03-05 2010-01-05 Intel Corporation Method, apparatus and system for seamlessly sharing a graphics device amongst virtual machines
US7971203B2 (en) * 2004-03-05 2011-06-28 Intel Corporation Method, apparatus and system for dynamically reassigning a physical device from one virtual machine to another
US8973087B2 (en) * 2004-05-10 2015-03-03 Sap Se Method and system for authorizing user interfaces
US7707583B2 (en) * 2004-05-20 2010-04-27 Sap Ag Robust sharing of runtime systems
US7587721B2 (en) * 2004-05-20 2009-09-08 Sap Ag Sharing objects in runtime systems
US7415704B2 (en) * 2004-05-20 2008-08-19 Sap Ag Sharing objects in runtime systems
US8099395B2 (en) * 2004-06-24 2012-01-17 Oracle America, Inc. System level identity object
US8640035B2 (en) * 2004-06-24 2014-01-28 Oracle America, Inc. Identity based user interface
US7797293B2 (en) * 2004-06-24 2010-09-14 Oracle America, Inc. Adaptive contact list
US20060069828A1 (en) * 2004-06-30 2006-03-30 Goldsmith Michael A Sharing a physical device among multiple clients
US7620953B1 (en) * 2004-10-05 2009-11-17 Azul Systems, Inc. System and method for allocating resources of a core space among a plurality of core virtual machines
GB2419701A (en) * 2004-10-29 2006-05-03 Hewlett Packard Development Co Virtual overlay infrastructure with dynamic control of mapping
US7653721B1 (en) * 2004-10-29 2010-01-26 Sun Microsystems, Inc. Mechanism for capturing high level events on user interface components
US8458467B2 (en) * 2005-06-21 2013-06-04 Cisco Technology, Inc. Method and apparatus for adaptive application message payload content transformation in a network infrastructure element
WO2006085158A2 (en) * 2004-12-03 2006-08-17 Alexey Khoroshev Multi-screen computer device
US20060236328A1 (en) * 2004-12-10 2006-10-19 Siemens Medical Solutions Usa, Inc. Integrated graphical user interface server for use with multiple client applications
US7734999B2 (en) * 2005-01-03 2010-06-08 Emergis Inc. System and method for providing forms on a user interface
US7900152B2 (en) * 2005-03-03 2011-03-01 Microsoft Corporation Adaptable user interface for business software
US8799800B2 (en) * 2005-05-13 2014-08-05 Rockwell Automation Technologies, Inc. Automatic user interface generation
US8635094B2 (en) * 2005-06-03 2014-01-21 International Business Machines Corporation System and method for dynamically configuring user interface components of a collaborative space based on mapping rules and user roles
US7681200B2 (en) * 2005-07-22 2010-03-16 Microsoft Corporation Secure hardware desktop buffer composition
US7395456B2 (en) * 2005-08-17 2008-07-01 Microsoft Corporation Query-based identification of user interface elements
US7708493B2 (en) * 2005-08-26 2010-05-04 Searete, Llc Modifiable display marker
US7765560B2 (en) * 2005-10-26 2010-07-27 Oracle America, Inc. Object oriented communication between isolates
US8922457B2 (en) * 2005-11-07 2014-12-30 Jerry Moscovitch Controller and graphics assemblies in multi-screen display systems
US8112513B2 (en) * 2005-11-30 2012-02-07 Microsoft Corporation Multi-user display proxy server
US20070136134A1 (en) * 2005-12-12 2007-06-14 Jerry Moscovitch Method and System for Generating Revenue Using a Multi-Screen Display System
US8028040B1 (en) * 2005-12-20 2011-09-27 Teradici Corporation Method and apparatus for communications between a virtualized host and remote devices
US20070159560A1 (en) * 2006-01-11 2007-07-12 Jerry Moscovitch Multi-Directional Multi-Screen Display System
US20070168872A1 (en) * 2006-01-19 2007-07-19 Raytheon Company Multi-monitor, multi-JVM java GUI infrastructure with layout via XML
US20070174429A1 (en) * 2006-01-24 2007-07-26 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine hosting a requested computing environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050039183A1 (en) * 2000-01-28 2005-02-17 Francisco Romero System and method for allocating a plurality of resources between a plurality of computing domains
US6717596B1 (en) * 2000-02-18 2004-04-06 Xsides Corporation Method and system for controlling a complementary user interface on a display surface
US20040226041A1 (en) * 2000-02-18 2004-11-11 Xsides Corporation System and method for parallel data display of multiple executing environments
US20040044953A1 (en) * 2000-11-18 2004-03-04 Andrew Watkins Resource files for electronic devices
US20050015307A1 (en) * 2003-04-28 2005-01-20 Simpson Todd Garrett Method and system of providing location sensitive business information to customers

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070174784A1 (en) * 2006-01-26 2007-07-26 Tangtake Technology Co., Ltd. Method for presenting objects of the windows operating environment on multiple display devices
US20100064251A1 (en) * 2008-09-05 2010-03-11 International Business Machines Corporation Toggling window display state by screen in a multi-screened desktop environment
US11500604B2 (en) * 2011-06-30 2022-11-15 International Business Machines Corporation Presenting a document on a computer
CN103777966A (en) * 2014-02-28 2014-05-07 广州视源电子科技股份有限公司 Method and device for extracting code information from binary file
CN107544805A (en) * 2017-09-04 2018-01-05 同济大学 Mobile phone games system architecture based on android system reusable framework
CN107544805B (en) * 2017-09-04 2020-08-14 同济大学 Mobile phone game system architecture based on reusable frame of Android system
US10951661B1 (en) * 2018-05-08 2021-03-16 Amazon Technologies, Inc. Secure programming interface hierarchies

Also Published As

Publication number Publication date
US20100146505A1 (en) 2010-06-10
US8863015B2 (en) 2014-10-14

Similar Documents

Publication Publication Date Title
US8863015B2 (en) Multi-monitor, multi-JVM java GUI infrastructure with layout via XML
US5793368A (en) Method for dynamically switching between visual styles
US7707563B2 (en) System and method for network-based computing
US7614052B2 (en) System and method for developing and deploying computer applications over a network
US6342907B1 (en) Specification language for defining user interface panels that are platform-independent
US10268359B2 (en) Space-optimizing content display
US7636722B2 (en) System and method for describing application extensions in XML
US8196096B2 (en) .Net ribbon model for a ribbon user interface
US6085120A (en) Data system processing and method for creating application extension
US20060010422A1 (en) Common user interface development toolkit for a system administration program
US20050138567A1 (en) Method of realistically displaying and interacting with electronic files
JP2012084165A (en) Program for causing computer to generate user interface
EP1388040B1 (en) Method and apparatus for lightweight support on set top box
US20020188703A1 (en) Graphical tool for developing computer programs via specifications
Pavlidis Fundamentals of X programming: graphical user interfaces and beyond
Besacier et al. Toward user interface virtualization: legacy applications and innovative interaction systems
EP1717694A1 (en) State-machine driven web application
Finlay PyGTK 2.0 Tutorial
Mikkonen et al. Towards a uniform web application platform for desktop computers and mobile devices
Sage et al. Adding a Graphical User Interface
Uotila A User Interface Toolkit for a Small Screen Device.
Jgr Programming With C#. Net
Thomas et al. Y: A Successor to the x Window System
Mamone Creating Windows Forms
Griswold A Java implementation of a portable desktop manager

Legal Events

Date Code Title Description
AS Assignment

Owner name: RAYTHEON COMPANY, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ALMONTE, NICHOLAS A.;STUBBS, WILLIAM R.;REEL/FRAME:017487/0117

Effective date: 20060109

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION