WO2012129218A1 - Contextual display and scrolling of search results in graphical environment - Google Patents

Contextual display and scrolling of search results in graphical environment Download PDF

Info

Publication number
WO2012129218A1
WO2012129218A1 PCT/US2012/029784 US2012029784W WO2012129218A1 WO 2012129218 A1 WO2012129218 A1 WO 2012129218A1 US 2012029784 W US2012029784 W US 2012029784W WO 2012129218 A1 WO2012129218 A1 WO 2012129218A1
Authority
WO
WIPO (PCT)
Prior art keywords
item
items
visual representation
databases
selection
Prior art date
Application number
PCT/US2012/029784
Other languages
French (fr)
Inventor
Tomer Dror
Original Assignee
Hexagon Technology Center Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hexagon Technology Center Gmbh filed Critical Hexagon Technology Center Gmbh
Priority to KR1020137025737A priority Critical patent/KR20140002750A/en
Priority to AU2012231129A priority patent/AU2012231129A1/en
Priority to BR112013023546A priority patent/BR112013023546A2/en
Priority to EP12761409.7A priority patent/EP2689358A4/en
Priority to CA2829636A priority patent/CA2829636A1/en
Priority to CN2012800132245A priority patent/CN103443793A/en
Publication of WO2012129218A1 publication Critical patent/WO2012129218A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/12Symbolic schematics

Definitions

  • the present invention relates to computerized tools that assist with the design of engineering projects, and more particularly to graphical displays of individual components of engineering projects, wherein the graphical or numerical properties of the components are shown to a user in the context of the overall design.
  • CAD computer-assisted design
  • GIS geographic information system
  • FIG. 1 Various embodiments of the invention simultaneously present two views of a component, a local view and a global view, in an integrated display, thereby improving ease of use of the design system.
  • These embodiments improve prior art systems because, among other reasons, they collect the data displayed in the integrated display from multiple database sources that were created by mutually non-interoperable software applications. Further, by showing both local and global information together, such embodiments eliminate the distraction of switching between these software applications, or between views in a single application, in order to understand both of these design perspectives.
  • a first embodiment includes a method of displaying information that relates to a plurality of items in an engineering design. Each item is associated with a visual representation (as defined below) that shows both the item and at least one other item in the design.
  • the basic method has three steps: first receiving a selection of properties that relate to the engineering design; next retrieving records from a set of databases having data records; then causing display, on a graphical display device, of selectable indicia that correspond to at least one of the retrieved records.
  • Each record in each database has information associated with an item in the plurality of items.
  • the retrieved records relate to one or more items that have at least one property in the received selection of properties, as is known from the art of database programming.
  • Selection of an indicium causes simultaneous display of two images.
  • the first image is the visual representation associated with the item of the record that corresponds to the selected indicia.
  • the second image is a cropped image that shows a cropped portion of the visual representation.
  • the indicia may be arranged on the display device in a scrollable list, and the selection is performed in response to receiving an input from a user input device (such as a mouse) having a physical input that has a scrolling function (such as a scroll wheel).
  • a user input device such as a mouse
  • a scrolling function such as a scroll wheel
  • at least two of the databases have different storage formats.
  • the visual representation associated with at least one item in the plurality of items may be an image file or a graphical user interface of a software application.
  • the cropped image may be a portion of the visual representation that is enlarged and centered on the item, and may include a crop area that may be resized by a user to display more or less of the enlarged portion.
  • a portion of the visual representation that does not include the item has an opacity that is user-adjustable.
  • a further embodiment includes a tangible, computer-usable storage medium on which is stored program code for performing the steps of the above method or its enhancements.
  • Another further embodiment includes a system for carrying out the steps of the method or its enhancements. Such a system may be a computer configured to execute the program code just described.
  • FIG. 1 shows the various components of a system in accordance with an embodiment of the present invention
  • Fig. 2 shows a collection of graphical properties, stored in one or more databases of Fig. 1 , that are possessed by a plurality of items in an engineering design;
  • Fig. 3 shows a collection of functional properties possessed by these items
  • Fig. 4 shows a representation of a graphical display for filtering items, from the one or more databases, for contextual display
  • Fig. 5 shows graphical properties of items that have been filtered
  • Fig. 6 shows a representation of a graphical display for displaying information that relates in general to the filtered items, and in particular to a currently selected item;
  • Fig. 7 shows the graphical display of Fig. 6, after a user has enlarged the crop area of the currently selected item
  • Fig. 8 shows the graphical display of Fig. 7, after a user has altered the opacity of the non-selected items
  • Fig. 9 shows the graphical display of Fig. 6, after a user has selected a new item for contextual display.
  • FIG. 10 is a flowchart showing a method for displaying items in accordance with one embodiment of the invention. Detailed Description of Illustrative Embodiments
  • a visual representation of an item is an image of the item in a specified design context.
  • An item such as a component in an engineering design, may have several different contexts in relation to the design.
  • a furnace used to heat a reaction vessel may be viewed in the context of a system of fuel and waste pipes, a system of electrical wiring, a system of heat sources, and so on.
  • Each context may have its own visual representation; for example, the furnace may appear in the structural blueprints, the electrical wiring diagram, in a 3D view of a cross-section of the plant, and so on. In this way, the furnace is associated with several visual representations.
  • any given visual representation typically will show many different items, each of which is associated with it.
  • the electrical wiring diagram will show many electrical components. Thus, there is a many-to-many relationship between design elements and visual representations.
  • Fig. 1 shows the various components of a computer system 100 that may implement various embodiments of the invention.
  • the heart of computer system 100 is a design system 110 for assisting in the design and management of engineering projects.
  • the design system 110 may be a computer as is known in the art, several computers, or a portion of a single computer, but need only include such hardware, firmware, and software as is necessary to perform the functions of the methods described herein.
  • Fig. 1 omits various components of design system 110, such as a computer processor, volatile memory, input devices like mice and keyboards, and other devices and subsystems known to be useful in the art of computer systems generally.
  • the design system 110 includes a design application 111, which includes a combination of hardware and software for permitting a user to design an engineering project.
  • exemplary application 111 contains program code for manipulating various information and data relating to the project, program code for a graphical user interface (GUI) that allows the user to visualize the project or its associated data in 2D or 3D, and program code for a series of control elements in the GUI that permit the user to modify the underlying project data.
  • GUI graphical user interface
  • Other embodiments of application 111 may accomplish these features in hardware or firmware for additional speed.
  • the design system 110 includes a number of adapters for communicating with other devices and systems.
  • the design system 110 includes two display adapters 112a, 112b for transmitting images from application 111 to display devices 120a, 120b, although more or fewer display devices may be used.
  • Exemplary display adapters 112a, 112b are graphics cards, but networking cards, or other hardware or software devices as known in the art may be used.
  • Exemplary display devices 120a, 120b are computer monitors, but televisions, smartphones, PDAs, or any other adequate display devices may be used.
  • the types of images transmitted include, for example, 3D schematics of a project, 2D blueprints of the project, other schematics of various mechanical, electrical, safety, or other systems of the project, project schedules, personnel rosters, and images of any other aspect of the design and implementation of the project.
  • the images may represent text documents, spreadsheets, databases, or any other organization of information, including the graphical display of a software application.
  • the design system 110 also includes an imaging adapter 114 for generating and reading image files 130.
  • the imaging adapter 114 is typically embodied as file formatting software that formats and parses image data, including JPEG, GIF, PNG, and other image formats as known in the art. Images of schematics, blueprints, and so on are processed by the imaging adapter 114 to create image files 130. Conversely, the image files 130 may be read and parsed by imaging adapter 114 for transmission to the display devices 120.
  • the design system 110 interfaces with several other systems and applications associated with the project.
  • a design requirements software application 140 may be used in the initial phases of design to collect and organize all of the design requirements pertaining to one or more projects.
  • the requirements application 140 stores all of its data in a database 142.
  • Manufacturing application 150 uses a database 152 to store its data.
  • a logistics application 160 may be used to coordinate project implementation according to a work breakdown structure, for example as shown in a Gantt chart. Its data is stored in database 162.
  • each database includes a collection of records, and in accordance with various embodiments of the invention, each record in the database has information that is associated with a component in the design.
  • the databases 142, 152, 162 may contain data in different formats, such as flat text, CSV, XLS, XML, ISAM, and so on.
  • the design system 110 includes database adapters 116a-c that permit the design system 110 to read (and optionally write) data to the databases 142, 152, 162 respectively. Additionally, to the extent required, the design system 110 includes its own database 118 of information in which it stores project design data.
  • Fig. 2 shows an example collection of graphical properties, stored in one or more of the databases 118, 142, 152, 162.
  • Each item in the design has various graphical properties, and is associated with one or more visual representation.
  • a visual representation for one item may be a drawing, such as an image file 130.
  • a visual representation for a different item may be a dynamically-generated graphical user interface of a software application, such as a web browser, a word processor, a spreadsheet, a slideshow application, a diagramming application, or other application.
  • Such visual representations may be obtained from the external application by the design system 110 using, in one embodiment, Object Linking and Embedding (OLE) technology developed by Microsoft Corporation of Redmond, Washington.
  • OLE Object Linking and Embedding
  • a different embodiment instead may use a web service, such as one that conforms to the Web Services Description Language (WSDL), or that uses XML-RPC or its successor, SOAP.
  • WSDL Web Services Description Language
  • WCF Windows Communication Foundation
  • FIG. 2 shows three drawings having drawing IDs 1, 2, and 3. Each drawing includes four components; thus, drawing 1 includes Motor 1, Connector2, Motor3, and Panel4, and so on for the other drawings.
  • the graphical properties for these components are represented as X- and Y-coordinates and a length, as shown. In a typical application, many more properties would be present, including complete descriptions of the sizes and shapes of these components so they may be rendered in the drawing— these additional fields are omitted for clarity.
  • Fig. 3 shows a sample of functional properties possessed by the items of Fig. 2.
  • Motorl has a maximum input current of 10 amperes.
  • many more functional properties would be contained in the database, and the values listed in Fig. 3 are exemplary only.
  • the functional properties of various components may be stored in one of the databases 118, 142, 152, 162 while the graphical properties of those same components may be stored in a different database, or several different databases.
  • Fig. 4 is a representation of a graphical display for filtering items, from the one or more databases, for contextual display in accordance with an embodiment of the invention.
  • a filter window 410 is graphically displayed on a display as part of the graphical user interface.
  • the filter window 410 includes a property selector 420, an operator selector 430, a value selector 440, and a Run Query button 450.
  • the property selector 420 includes a selection of properties in a pull-down menu.
  • Each functional property has a related value.
  • the operator selector 430 is provided as a pull-down menu to permit a user to select a relationship relative to that value, and a value selector 440 is provided as a spinner to receive a value corresponding to the operator.
  • the currently selected filter is "components having a maximum input current equal to 10 amperes".
  • the exemplary graphical interface shown in Fig. 4 is not limiting.
  • the selectors 420, 430, 440 may be other than pull-down menus and spinners.
  • Any input widgets known in the art may be used to receive a filter selection, including for example check boxes, radio buttons, clickable icons, text fields, text areas, list windows, scroll bars, sliders, tables, and trees.
  • other input fields may be present in the GUI, such as component name, component type, design system (electrical, structural, sensor system, etc.), project name or subproject name, and the like.
  • Fig. 5 shows the graphical properties of items that have been filtered using the example filter of Fig. 4 and the listings of Figs. 2 and 3.
  • the example filter is "components having a maximum input current equal to 10 amperes". From Fig. 3, these components are Motor 1, Motor8, and Motor9, but not Motor3. Referring then to Fig. 2, for example, Motor 1 appears in drawing 1, its coordinates are (10, 10), and its length is 1.
  • Motor8 appears in drawing 2, and has the same coordinates and length. These data are identified for all components that match the filter criteria, and are collected in a single list as shown in Fig. 5. As noted above, the functional and graphical properties of each component may be stored in different databases. Thus, in one embodiment the design system is capable of assembling and manipulating information derived from a number of different databases, which allows it to perform the indicating filtering function using data generated by several different external applications.
  • Fig. 6 is a representation of an example graphical display for displaying information that relates in general to the filtered items.
  • the graphical user interface (GUI) 600 has several areas, including a scrollable list of filtered components 610, a secondary viewing panel 620 for viewing a visual representation of an item, and a primary viewing panel 630 for viewing a cropped image of the visual representation. Each of these is described in greater detail in turn.
  • the scrollable list 610 includes a collection of selectable indicia that correspond to the database records retrieved by the search process described above.
  • Motor 1, Motor8, and Motor9 appear in the search results, along with their relevant graphical properties.
  • the functional properties of the relevant components may be displayed, along with any other associated information.
  • the first row in its entirety is a selectable indicium 612, and is shown in a highlighted state.
  • other indicia may be used, such as icons, and in their selected state they may be highlighted using an outline as shown, a different colored background, different colored text, a combination of these, or they may not be highlighted at all.
  • the design system causes simultaneous display of two images of the component that corresponds to the selected indicium, one image in the primary viewing panel 630 and one in the secondary viewing panel 620.
  • the secondary viewing panel 620 includes, for the selected component, a visual representation of the component identified by an indicium 612 in its larger context.
  • the visual representation is an entire electrical wiring diagram which is stored in a file as Drawing 1.
  • a component may be associated with several visual representations. If a particular system or subsystem is not one of the filter criteria, the same physical component may have several indicia in the list 610, one for each context, and each indicium is associated with a different visual representation that may be displayed in the secondary viewing panel 620.
  • the visual representation shown in the panel 620 also includes many other components, including the component identified by the selected indicium.
  • the primary viewing panel 630 includes a viewing area 632 that has an enlarged view of the visual representation.
  • the view is centered on the selected component 622 using the coordinates of the component.
  • the view corresponds to crop boundaries, shown by a box 640, within the visual representation shown in the panel 620.
  • the view of the selected component is scaled and rotated to a standard size and orientation for this type of component (in this case, a motor). In some embodiments this is done automatically, while in others, the visual representation shown in the panel 620 is scaled by a fixed magnification. In some embodiments, the user can change magnification using a GUI widget such as a slider bar (not shown).
  • the viewing area 632 is itself centered in the panel 630, and its initial size may be determined using graphical properties of the component. For example, Motorl has length 1, so the viewing area 632 has a length and width of
  • the GUI advantageously allows a user to simultaneously see both local and global views of the component in its subsystem context, thereby improving ease of use of the design system.
  • This system improves prior art systems in part because it eliminates the distraction of switching between software applications, or between views in a single application, in order to visualize both local and global properties of a component. It also advantageously collects the data displayed in list 610 and the visual representations of the panels 620, 630 from multiple databases 118, 142, 152, 162, some of which may have been created by mutually non-interoperable software applications.
  • an embodiment of the invention may include other features in a GUI.
  • the embodiment may give a user the ability to enlarge the crop area, to display more or fewer nearby components.
  • a viewing area 710 now shows nearby electrical components.
  • the positive terminal of the selected motor is connected to an 8V supply. While the crop area of Fig. 6 was a square, the crop area of Fig. 7 is a larger rectangle of unequal dimensions.
  • the user may adjust the opacity of the portions of the visual representation not within the cropped area.
  • Fig. 8 where the user has reduced the opacity from 100%, as in Fig. 6, down to 0%>.
  • the user has set all of the viewing area 810 to be fully visible. Opacities between 0% and 100%) may be used.
  • a crop box 812 is shown for reference, and indicates to the user which portions of the viewing area 810 will be darkened or lightened by adjusting the opacity because they are outside the crop box 812.
  • a scroll bar or a mouse may be used to navigate the enlarged view when the entire view does not fit into the viewing area 810. For example, a click-and-drag operation as known in the art may be performed to move the displayed portion of the visual representation.
  • the user may select another indicium, as shown in Fig. 9.
  • a second indicium 910 has been selected, corresponding to the component 920 in Drawing 2.
  • This component namely, Motor8
  • This component is shown in a viewing area 930 as an enlarged component 932.
  • the component has been scaled and rotated so that its image may be easily compared with the image of the previous component. In some embodiments, this is done automatically, while in others the user must scale and rotate the view according to other widgets in the GUI (not shown).
  • Selection of the second indicium may be performed using any number of techniques, including the use of a user input device that has a physical input with a scrolling function.
  • a scroll wheel on a mouse may be used.
  • an input device with a trackball may be used.
  • a touch pad having specified area typically a strip along the right-hand edge
  • scrolling between images is known in the art, various embodiments of the present invention permit scrolling between images of components, filtered using specific search criteria, that are dynamically centered and enlarged based on graphical properties retrieved from one or more databases.
  • the scrollable feature of these embodiments is thus an improvement over the prior art, as all of the visual information and graphical data from multiple sources is collected together, resizing and centering is automated, and several views of each component are displayed in an integrated display that permits simple scrolling.
  • Fig. 10 is a flowchart showing a method for displaying items in accordance with one embodiment of the invention.
  • an embodiment receives a selection of properties in a GUI that is displayed on a graphical display. The properties may be selected using an input window such as that shown in Fig. 4 and described above.
  • the embodiment retrieves records from a set of databases that relate to items having at least one of the selected properties. A typical results list is shown in Fig. 5.
  • the embodiment displays selectable indicia that correspond to the retrieved records, and two images of a first item, on the graphical display. An example of such a display is shown in Fig. 6.
  • the first image is a visual representation of the first item in the list, such as the secondary viewing panel 620.
  • the second image is a cropped, enlarged view of the first item in the list, such as shown in the viewing area 632.
  • the embodiment receives selection of an indicium, using a user input device having a physical input with a scrolling function, such as a mouse or trackball.
  • the embodiment displays two images of the second, selected item on the graphical display.
  • the embodiments of the invention described above are intended to be merely exemplary; numerous variations and modifications will be apparent to those skilled in the art.
  • the present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific
  • ASIC Integrated Circuit
  • Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as Fortran, C, C++, JAVA, or HTML) for use with various operating systems or operating environments.
  • the source code may define and use various data structures and communication messages.
  • the source code may be in a computer executable form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable form.
  • the computer program may be fixed in any form (e.g., source code form, computer executable form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device.
  • a semiconductor memory device e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM
  • a magnetic memory device e.g., a diskette or fixed disk
  • an optical memory device e.g., a CD-ROM
  • PC card e.g., PCMCIA card
  • the computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic
  • Hardware logic including programmable logic for use with a programmable logic device
  • implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL).
  • CAD Computer Aided Design
  • a hardware description language e.g., VHDL or AHDL
  • PLD programming language e.g., PALASM, ABEL, or CUPL

Abstract

A system and method are presented for aggregating and displaying information that relates to items in an engineering design. A system for designing engineering projects filters components of interest to a user, then collects data pertaining to the components from a set of databases that may be associated with mutually incompatible applications. The system presents, in a simple manner, an integrated display of the component properties and visual representations of the filtered components, both in isolation and in context. Multiple filtered components may be scrolled using a scrolling device such as a mouse wheel. The visual representations may be cropped with a resizable crop box, and non-selected components outside the crop box may have varying levels of opacity.

Description

Contextual Display and Scrolling of Search Results in Graphical Environment
Technical Field
[0001] The present invention relates to computerized tools that assist with the design of engineering projects, and more particularly to graphical displays of individual components of engineering projects, wherein the graphical or numerical properties of the components are shown to a user in the context of the overall design.
Background Art
[0002] Many interactive, graphical computer software applications process vast amounts of complex three-dimensional model data for presentation on one or more video displays. Such applications include, for example, computer-assisted design (CAD) tools for designing three-dimensional articles, buildings, and vehicles for manufacture, and geographic information system (GIS) tools, which are used to track public transit systems or communications networks.
[0003] These applications are often at the heart of design systems that must manipulate a complex array of information. A typical application may have to process a design containing thousands or even millions of components. And every component may be associated with information pertaining to its purpose in the design, its specifications and required tolerances, its cost and lead time, a vendor to manufacture it, a construction schedule, on-site delivery data, testing and check-out data, and many other data. These data are not typically stored in one location; rather, they exist in a collection of databases associated with several different applications that have different users. For example, the 3D specification of a component may be useful to a design engineer, while the cost and lead time information may be useful to a project manager. Because of the diverse nature of the data, assembling them in one place to obtain a global perspective of all information pertaining to a particular component is difficult. Summary of Illustrative Embodiments
[0004] Various embodiments of the invention simultaneously present two views of a component, a local view and a global view, in an integrated display, thereby improving ease of use of the design system. These embodiments improve prior art systems because, among other reasons, they collect the data displayed in the integrated display from multiple database sources that were created by mutually non-interoperable software applications. Further, by showing both local and global information together, such embodiments eliminate the distraction of switching between these software applications, or between views in a single application, in order to understand both of these design perspectives.
[0005] A first embodiment includes a method of displaying information that relates to a plurality of items in an engineering design. Each item is associated with a visual representation (as defined below) that shows both the item and at least one other item in the design. The basic method has three steps: first receiving a selection of properties that relate to the engineering design; next retrieving records from a set of databases having data records; then causing display, on a graphical display device, of selectable indicia that correspond to at least one of the retrieved records. Each record in each database has information associated with an item in the plurality of items. The retrieved records relate to one or more items that have at least one property in the received selection of properties, as is known from the art of database programming. Selection of an indicium causes simultaneous display of two images. The first image is the visual representation associated with the item of the record that corresponds to the selected indicia. The second image is a cropped image that shows a cropped portion of the visual representation.
[0006] There are various enhancements that may be applied to this embodiment. For example, the indicia may be arranged on the display device in a scrollable list, and the selection is performed in response to receiving an input from a user input device (such as a mouse) having a physical input that has a scrolling function (such as a scroll wheel). In some related embodiments, at least two of the databases have different storage formats. The visual representation associated with at least one item in the plurality of items may be an image file or a graphical user interface of a software application. The cropped image may be a portion of the visual representation that is enlarged and centered on the item, and may include a crop area that may be resized by a user to display more or less of the enlarged portion. In some embodiments, a portion of the visual representation that does not include the item has an opacity that is user-adjustable.
[0007] A further embodiment includes a tangible, computer-usable storage medium on which is stored program code for performing the steps of the above method or its enhancements. Another further embodiment includes a system for carrying out the steps of the method or its enhancements. Such a system may be a computer configured to execute the program code just described.
Brief Description of the Drawings
[0008] The foregoing features of embodiments will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
[0009] Fig. 1 shows the various components of a system in accordance with an embodiment of the present invention;
[0010] Fig. 2 shows a collection of graphical properties, stored in one or more databases of Fig. 1 , that are possessed by a plurality of items in an engineering design;
[0011] Fig. 3 shows a collection of functional properties possessed by these items;
[0012] Fig. 4 shows a representation of a graphical display for filtering items, from the one or more databases, for contextual display;
[0013] Fig. 5 shows graphical properties of items that have been filtered;
[0014] Fig. 6 shows a representation of a graphical display for displaying information that relates in general to the filtered items, and in particular to a currently selected item;
[0015] Fig. 7 shows the graphical display of Fig. 6, after a user has enlarged the crop area of the currently selected item;
[0016] Fig. 8 shows the graphical display of Fig. 7, after a user has altered the opacity of the non-selected items;
[0017] Fig. 9 shows the graphical display of Fig. 6, after a user has selected a new item for contextual display; and
[0018] Fig. 10 is a flowchart showing a method for displaying items in accordance with one embodiment of the invention. Detailed Description of Illustrative Embodiments
[0019] As used in this description and the accompanying claims, the following terms shall have the meanings indicated, unless the context otherwise requires:
[0020] A visual representation of an item is an image of the item in a specified design context. An item, such as a component in an engineering design, may have several different contexts in relation to the design. For example, in a chemical process plant, a furnace used to heat a reaction vessel may be viewed in the context of a system of fuel and waste pipes, a system of electrical wiring, a system of heat sources, and so on. Each context may have its own visual representation; for example, the furnace may appear in the structural blueprints, the electrical wiring diagram, in a 3D view of a cross-section of the plant, and so on. In this way, the furnace is associated with several visual representations. Conversely, any given visual representation typically will show many different items, each of which is associated with it. For example, the electrical wiring diagram will show many electrical components. Thus, there is a many-to-many relationship between design elements and visual representations.
[0021] Fig. 1 shows the various components of a computer system 100 that may implement various embodiments of the invention. The heart of computer system 100 is a design system 110 for assisting in the design and management of engineering projects. The design system 110 may be a computer as is known in the art, several computers, or a portion of a single computer, but need only include such hardware, firmware, and software as is necessary to perform the functions of the methods described herein. Thus, it will be understood that in some embodiments of the invention, more or fewer components will be present than those described in connection with the typical embodiment of Fig. 1. For clarity, Fig. 1 omits various components of design system 110, such as a computer processor, volatile memory, input devices like mice and keyboards, and other devices and subsystems known to be useful in the art of computer systems generally.
[0022] The design system 110 includes a design application 111, which includes a combination of hardware and software for permitting a user to design an engineering project. Exemplary application 111 contains program code for manipulating various information and data relating to the project, program code for a graphical user interface (GUI) that allows the user to visualize the project or its associated data in 2D or 3D, and program code for a series of control elements in the GUI that permit the user to modify the underlying project data. Other embodiments of application 111 may accomplish these features in hardware or firmware for additional speed.
[0023] The design system 110 includes a number of adapters for communicating with other devices and systems. Thus, the design system 110 includes two display adapters 112a, 112b for transmitting images from application 111 to display devices 120a, 120b, although more or fewer display devices may be used. Exemplary display adapters 112a, 112b are graphics cards, but networking cards, or other hardware or software devices as known in the art may be used. Exemplary display devices 120a, 120b are computer monitors, but televisions, smartphones, PDAs, or any other adequate display devices may be used. The types of images transmitted include, for example, 3D schematics of a project, 2D blueprints of the project, other schematics of various mechanical, electrical, safety, or other systems of the project, project schedules, personnel rosters, and images of any other aspect of the design and implementation of the project. The images may represent text documents, spreadsheets, databases, or any other organization of information, including the graphical display of a software application.
[0024] The design system 110 also includes an imaging adapter 114 for generating and reading image files 130. The imaging adapter 114 is typically embodied as file formatting software that formats and parses image data, including JPEG, GIF, PNG, and other image formats as known in the art. Images of schematics, blueprints, and so on are processed by the imaging adapter 114 to create image files 130. Conversely, the image files 130 may be read and parsed by imaging adapter 114 for transmission to the display devices 120.
[0025] In accordance with various embodiments of the invention, the design system 110 interfaces with several other systems and applications associated with the project. For example, a design requirements software application 140 may be used in the initial phases of design to collect and organize all of the design requirements pertaining to one or more projects. The requirements application 140 stores all of its data in a database 142. When all of the requirements have been determined, parts may need to be ordered, for which a manufacturing work order application 150 is used. Manufacturing application 150 uses a database 152 to store its data. A logistics application 160 may be used to coordinate project implementation according to a work breakdown structure, for example as shown in a Gantt chart. Its data is stored in database 162.
[0026] As is known in the art, each database includes a collection of records, and in accordance with various embodiments of the invention, each record in the database has information that is associated with a component in the design. As will be appreciated, the databases 142, 152, 162 may contain data in different formats, such as flat text, CSV, XLS, XML, ISAM, and so on. To facilitate interoperability of the design application 111 with these other systems, the design system 110 includes database adapters 116a-c that permit the design system 110 to read (and optionally write) data to the databases 142, 152, 162 respectively. Additionally, to the extent required, the design system 110 includes its own database 118 of information in which it stores project design data.
[0027] Fig. 2 shows an example collection of graphical properties, stored in one or more of the databases 118, 142, 152, 162. Each item in the design has various graphical properties, and is associated with one or more visual representation. A visual representation for one item may be a drawing, such as an image file 130. Alternatively, a visual representation for a different item may be a dynamically-generated graphical user interface of a software application, such as a web browser, a word processor, a spreadsheet, a slideshow application, a diagramming application, or other application. Such visual representations may be obtained from the external application by the design system 110 using, in one embodiment, Object Linking and Embedding (OLE) technology developed by Microsoft Corporation of Redmond, Washington. A different embodiment instead may use a web service, such as one that conforms to the Web Services Description Language (WSDL), or that uses XML-RPC or its successor, SOAP. Another embodiment may use Microsoft's Windows Communication Foundation (WCF), or other comparable technology for this purpose.
[0028] Fig. 2 shows three drawings having drawing IDs 1, 2, and 3. Each drawing includes four components; thus, drawing 1 includes Motor 1, Connector2, Motor3, and Panel4, and so on for the other drawings. The graphical properties for these components are represented as X- and Y-coordinates and a length, as shown. In a typical application, many more properties would be present, including complete descriptions of the sizes and shapes of these components so they may be rendered in the drawing— these additional fields are omitted for clarity.
[0029] Fig. 3 shows a sample of functional properties possessed by the items of Fig. 2. Thus, Motorl has a maximum input current of 10 amperes. In a typical embodiment, many more functional properties would be contained in the database, and the values listed in Fig. 3 are exemplary only. As will be appreciated from the above discussion, the functional properties of various components may be stored in one of the databases 118, 142, 152, 162 while the graphical properties of those same components may be stored in a different database, or several different databases.
[0030] It is useful in various embodiments for the design application 111 to provide a user with the ability to select various items from the design. For example, an engineer may wish to focus her attention on a particular subset of the motors, or on the heat sources. To that end, Fig. 4 is a representation of a graphical display for filtering items, from the one or more databases, for contextual display in accordance with an embodiment of the invention. A filter window 410 is graphically displayed on a display as part of the graphical user interface. The filter window 410 includes a property selector 420, an operator selector 430, a value selector 440, and a Run Query button 450. The property selector 420 includes a selection of properties in a pull-down menu. These properties correspond to the functional properties of Fig. 3. Each functional property has a related value. The operator selector 430 is provided as a pull-down menu to permit a user to select a relationship relative to that value, and a value selector 440 is provided as a spinner to receive a value corresponding to the operator. Thus, as shown in Fig. 4, the currently selected filter is "components having a maximum input current equal to 10 amperes". Once the user has selected an appropriate filter, the design system receives and processes the selection when the user presses the Run Query button 450. After the filtering process is complete, the components that meet the selection criteria are displayed as discussed in greater detail below in connection with Fig. 6.
[0031] It should be understood that the exemplary graphical interface shown in Fig. 4 is not limiting. In particular, the selectors 420, 430, 440 may be other than pull-down menus and spinners. Any input widgets known in the art may be used to receive a filter selection, including for example check boxes, radio buttons, clickable icons, text fields, text areas, list windows, scroll bars, sliders, tables, and trees. Additionally, other input fields may be present in the GUI, such as component name, component type, design system (electrical, structural, sensor system, etc.), project name or subproject name, and the like.
[0032] Fig. 5 shows the graphical properties of items that have been filtered using the example filter of Fig. 4 and the listings of Figs. 2 and 3. In particular, the example filter is "components having a maximum input current equal to 10 amperes". From Fig. 3, these components are Motor 1, Motor8, and Motor9, but not Motor3. Referring then to Fig. 2, for example, Motor 1 appears in drawing 1, its coordinates are (10, 10), and its length is 1.
Motor8 appears in drawing 2, and has the same coordinates and length. These data are identified for all components that match the filter criteria, and are collected in a single list as shown in Fig. 5. As noted above, the functional and graphical properties of each component may be stored in different databases. Thus, in one embodiment the design system is capable of assembling and manipulating information derived from a number of different databases, which allows it to perform the indicating filtering function using data generated by several different external applications.
[0033] Fig. 6 is a representation of an example graphical display for displaying information that relates in general to the filtered items. The graphical user interface (GUI) 600 has several areas, including a scrollable list of filtered components 610, a secondary viewing panel 620 for viewing a visual representation of an item, and a primary viewing panel 630 for viewing a cropped image of the visual representation. Each of these is described in greater detail in turn.
[0034] In this example embodiment, the scrollable list 610 includes a collection of selectable indicia that correspond to the database records retrieved by the search process described above. Thus, Motor 1, Motor8, and Motor9 appear in the search results, along with their relevant graphical properties. It will be understood that, in addition to their graphical properties, the functional properties of the relevant components may be displayed, along with any other associated information.
[0035] In Fig. 6, the first row in its entirety is a selectable indicium 612, and is shown in a highlighted state. In alternative embodiments, other indicia may be used, such as icons, and in their selected state they may be highlighted using an outline as shown, a different colored background, different colored text, a combination of these, or they may not be highlighted at all. When a user selects an indicium, for example the first row of Fig. 6, the design system causes simultaneous display of two images of the component that corresponds to the selected indicium, one image in the primary viewing panel 630 and one in the secondary viewing panel 620.
[0036] The secondary viewing panel 620 includes, for the selected component, a visual representation of the component identified by an indicium 612 in its larger context. In Fig. 6, for example, the visual representation is an entire electrical wiring diagram which is stored in a file as Drawing 1. As noted above, a component may be associated with several visual representations. If a particular system or subsystem is not one of the filter criteria, the same physical component may have several indicia in the list 610, one for each context, and each indicium is associated with a different visual representation that may be displayed in the secondary viewing panel 620. The visual representation shown in the panel 620 also includes many other components, including the component identified by the selected indicium.
[0037] The primary viewing panel 630 includes a viewing area 632 that has an enlarged view of the visual representation. The view is centered on the selected component 622 using the coordinates of the component. In particular, the view corresponds to crop boundaries, shown by a box 640, within the visual representation shown in the panel 620. The view of the selected component is scaled and rotated to a standard size and orientation for this type of component (in this case, a motor). In some embodiments this is done automatically, while in others, the visual representation shown in the panel 620 is scaled by a fixed magnification. In some embodiments, the user can change magnification using a GUI widget such as a slider bar (not shown). The viewing area 632 is itself centered in the panel 630, and its initial size may be determined using graphical properties of the component. For example, Motorl has length 1, so the viewing area 632 has a length and width of
approximately 2.
[0038] By simultaneously presenting a magnified view of the component in the primary viewing panel 630 and a contextual view of the component in the secondary viewing panel 620, the GUI advantageously allows a user to simultaneously see both local and global views of the component in its subsystem context, thereby improving ease of use of the design system. This system improves prior art systems in part because it eliminates the distraction of switching between software applications, or between views in a single application, in order to visualize both local and global properties of a component. It also advantageously collects the data displayed in list 610 and the visual representations of the panels 620, 630 from multiple databases 118, 142, 152, 162, some of which may have been created by mutually non-interoperable software applications.
[0039] To further improve ease of use, an embodiment of the invention may include other features in a GUI. For example, the embodiment may give a user the ability to enlarge the crop area, to display more or fewer nearby components. Such an embodiment is shown in Fig. 7, in which a viewing area 710 now shows nearby electrical components. For example, it is now clear that the positive terminal of the selected motor is connected to an 8V supply. While the crop area of Fig. 6 was a square, the crop area of Fig. 7 is a larger rectangle of unequal dimensions.
[0040] In another embodiment, the user may adjust the opacity of the portions of the visual representation not within the cropped area. Such an embodiment is pictured in Fig. 8, where the user has reduced the opacity from 100%, as in Fig. 6, down to 0%>. Thus, in Fig. 8, the user has set all of the viewing area 810 to be fully visible. Opacities between 0% and 100%) may be used. A crop box 812 is shown for reference, and indicates to the user which portions of the viewing area 810 will be darkened or lightened by adjusting the opacity because they are outside the crop box 812. While not shown in Fig. 8, in some embodiments a scroll bar or a mouse may be used to navigate the enlarged view when the entire view does not fit into the viewing area 810. For example, a click-and-drag operation as known in the art may be performed to move the displayed portion of the visual representation.
[0041] In addition to viewing the visual representation associated with the first selected indicium, the user may select another indicium, as shown in Fig. 9. Here, a second indicium 910 has been selected, corresponding to the component 920 in Drawing 2. This component (namely, Motor8) is shown in a viewing area 930 as an enlarged component 932. The component has been scaled and rotated so that its image may be easily compared with the image of the previous component. In some embodiments, this is done automatically, while in others the user must scale and rotate the view according to other widgets in the GUI (not shown).
[0042] Selection of the second indicium may be performed using any number of techniques, including the use of a user input device that has a physical input with a scrolling function. For example, a scroll wheel on a mouse may be used. In another embodiment, an input device with a trackball may be used. In yet another embodiment, a touch pad having specified area (typically a strip along the right-hand edge) is used to scroll between items in the list 610. While scrolling between images is known in the art, various embodiments of the present invention permit scrolling between images of components, filtered using specific search criteria, that are dynamically centered and enlarged based on graphical properties retrieved from one or more databases. The scrollable feature of these embodiments is thus an improvement over the prior art, as all of the visual information and graphical data from multiple sources is collected together, resizing and centering is automated, and several views of each component are displayed in an integrated display that permits simple scrolling.
[0043] Fig. 10 is a flowchart showing a method for displaying items in accordance with one embodiment of the invention. In step 1010, an embodiment receives a selection of properties in a GUI that is displayed on a graphical display. The properties may be selected using an input window such as that shown in Fig. 4 and described above. In step 1020, the embodiment retrieves records from a set of databases that relate to items having at least one of the selected properties. A typical results list is shown in Fig. 5. In step 1030, the embodiment displays selectable indicia that correspond to the retrieved records, and two images of a first item, on the graphical display. An example of such a display is shown in Fig. 6. The first image is a visual representation of the first item in the list, such as the secondary viewing panel 620. The second image is a cropped, enlarged view of the first item in the list, such as shown in the viewing area 632. In step 1040, the embodiment receives selection of an indicium, using a user input device having a physical input with a scrolling function, such as a mouse or trackball. Finally, in response to receiving the selection of the indicium, the embodiment displays two images of the second, selected item on the graphical display.
[0044] The embodiments of the invention described above are intended to be merely exemplary; numerous variations and modifications will be apparent to those skilled in the art. The present invention may be embodied in many different forms, including, but in no way limited to, computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific
Integrated Circuit (ASIC)), or any other means including any combination thereof.
[0045] Computer program logic implementing all or part of the functionality previously described herein may be embodied in various forms, including, but in no way limited to, a source code form, a computer executable form, and various intermediate forms (e.g., forms generated by an assembler, compiler, linker, or locator). Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as Fortran, C, C++, JAVA, or HTML) for use with various operating systems or operating environments. The source code may define and use various data structures and communication messages. The source code may be in a computer executable form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable form.
[0046] The computer program may be fixed in any form (e.g., source code form, computer executable form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM), a PC card (e.g., PCMCIA card), or other memory device. The computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic
documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web).
[0047] Hardware logic (including programmable logic for use with a programmable logic device) implementing all or part of the functionality previously described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL).
[0048] All such variations and modifications are intended to be within the scope of the present invention as defined in the appended claims

Claims

What is claimed is:
1. A method of displaying information that relates to a plurality of items in an engineering design, each item in the plurality of items being associated with a visual representation that shows both the item and at least one other item in the plurality of items, the method comprising:
receiving a selection of properties that relate to the engineering design;
retrieving records from a set of databases having data records, each record in each database having information associated with an item in the plurality of items, the retrieved records relating to one or more items that have at least one property in the received selection of properties; and
causing display, on a graphical display device, of selectable indicia that correspond to at least one of the retrieved records, wherein selection of an indicium causes to be simultaneously displayed:
(i) the visual representation associated with the item of the record that corresponds to the selected indicia, and
(ii) a cropped image that shows a cropped portion of the visual representation associated with said item.
2. The method of claim 1, wherein the indicia relating to the retrieved records are arranged on the display device in a scrollable list, and wherein receiving the selection is performed in response to receiving an input from a user input device having a physical input that has a scrolling function.
3. The method of claim 2, wherein the user input device is a mouse and the physical input is a scroll wheel.
4. The method of claim 1, wherein at least two databases in the set of databases have different storage formats.
5. The method of claim 1, wherein the visual representation associated with at least one item in the plurality of items includes an image file or a graphical user interface of a software application.
6. The method of claim 1, wherein the cropped image comprises a portion of the visual representation that is enlarged and centered on the item.
7. The method of claim 6, wherein the cropped image includes a crop area that may be resized by a user to display more or less of the enlarged portion.
8. The method of claim 1 , wherein a portion of the visual representation that does not include the item has an opacity that is user-adjustable.
9. A tangible, computer-usable storage medium on which is stored program code for displaying information that relates to a plurality of items in an engineering design, each item in the plurality of items being associated with a visual representation that shows both the item and at least one other item in the plurality of items, the program code comprising: program code for receiving a selection of properties that relate to the engineering design;
program code for retrieving records from a set of databases having data records, each record in each database having information associated with an item in the plurality of items, the retrieved records relating to one or more items that have at least one property in the received selection of properties; and
program code for causing display, on a graphical display device, of selectable indicia that correspond to at least one of the retrieved records, wherein selection of an indicium causes to be simultaneously displayed:
(i) the visual representation associated with the item of the record that corresponds to the selected indicia, and
(ii) a cropped image that shows a cropped portion of the visual representation associated with said item.
10. The storage medium of claim 9, further comprising program code for arranging the indicia relating to the retrieved records on the display device in a scrollable list, and program code for determining the selection in response to receiving an input from a user input device having a physical input that has a scrolling function.
11. The storage medium of claim 10, wherein the user input device is a mouse and the physical input is a scroll wheel.
12. The storage medium of claim 9, wherein at least two databases in the set of databases have different storage formats.
13. The storage medium of claim 9, wherein the visual representation associated with at least one item in the plurality of items includes an image file or a graphical user interface of a software application.
14. The storage medium of claim 9, wherein the cropped image comprises a portion of the visual representation that is enlarged and centered on the item.
15. The storage medium of claim 14, wherein the cropped image includes a crop area, further comprising program code for resizing the crop area to display more or less of the enlarged portion in response to a user input.
16. The storage medium of claim 9, further comprising program code for adjusting the opacity of a portion of the visual representation that does not include the item.
17. A system for displaying information that relates to a plurality of items in an engineering design, the system comprising:
a graphical display device;
a set of databases having data records, each record in each database having information associated with an item in the plurality of items; and a design system coupled to the graphical display device, the visual representations, and the set of databases, the design system comprising:
a display adapter configured to transmit images to the graphical display device;
an imaging adapter configured to generate, and read image files containing, visual representations of the items in the engineering design;
for each database in the set of databases, a database adapter configured to read data from the database; and
a design application configured to (i) receive a selection of properties that relate to the engineering design; (ii) retrieving records from the set of databases, the retrieved records relating to one or more items that have at least one property in the received selection of properties; and (iii) cause display, on the graphical display device, of selectable indicia that correspond to at least one of the retrieved records, wherein selection of an indicium causes to be simultaneously displayed the visual representation associated with the item of the record that corresponds to the selected indicia, and a cropped image that shows a cropped portion of the visual representation associated with said item.
18. The system of claim 17, wherein the display device is configurable to arrange the indicia relating to the retrieved records in a scrollable list, and further comprises a user input device having a physical input that has a scrolling function.
19. The system of claim 18, wherein the user input device is a mouse and the physical input is a scroll wheel.
20. The method of claim 17, wherein at least two databases in the set of databases have different storage formats.
21. The method of claim 17, wherein the visual representation associated with at least one item in the plurality of items includes an image file or a graphical user interface of a software application.
PCT/US2012/029784 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment WO2012129218A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
KR1020137025737A KR20140002750A (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment
AU2012231129A AU2012231129A1 (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment
BR112013023546A BR112013023546A2 (en) 2011-03-22 2012-03-20 contextual display and scrolling of search results in graphical environment
EP12761409.7A EP2689358A4 (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment
CA2829636A CA2829636A1 (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment
CN2012800132245A CN103443793A (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/053,586 US20120246148A1 (en) 2011-03-22 2011-03-22 Contextual Display and Scrolling of Search Results in Graphical Environment
US13/053,586 2011-03-22

Publications (1)

Publication Number Publication Date
WO2012129218A1 true WO2012129218A1 (en) 2012-09-27

Family

ID=46878187

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/029784 WO2012129218A1 (en) 2011-03-22 2012-03-20 Contextual display and scrolling of search results in graphical environment

Country Status (8)

Country Link
US (1) US20120246148A1 (en)
EP (1) EP2689358A4 (en)
KR (1) KR20140002750A (en)
CN (1) CN103443793A (en)
AU (1) AU2012231129A1 (en)
BR (1) BR112013023546A2 (en)
CA (1) CA2829636A1 (en)
WO (1) WO2012129218A1 (en)

Families Citing this family (130)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8930331B2 (en) 2007-02-21 2015-01-06 Palantir Technologies Providing unique views of data based on changes or rules
US8984390B2 (en) 2008-09-15 2015-03-17 Palantir Technologies, Inc. One-click sharing for screenshots and related documents
US9092482B2 (en) 2013-03-14 2015-07-28 Palantir Technologies, Inc. Fair scheduling for mixed-query loads
US9547693B1 (en) 2011-06-23 2017-01-17 Palantir Technologies Inc. Periodic database search manager for multiple data sources
US8799240B2 (en) 2011-06-23 2014-08-05 Palantir Technologies, Inc. System and method for investigating large amounts of data
US8732574B2 (en) 2011-08-25 2014-05-20 Palantir Technologies, Inc. System and method for parameterizing documents for automatic workflow generation
US8504542B2 (en) 2011-09-02 2013-08-06 Palantir Technologies, Inc. Multi-row transactions
US8799269B2 (en) 2012-01-03 2014-08-05 International Business Machines Corporation Optimizing map/reduce searches by using synthetic events
US8903813B2 (en) 2012-07-02 2014-12-02 International Business Machines Corporation Context-based electronic document search using a synthetic event
US8898165B2 (en) 2012-07-02 2014-11-25 International Business Machines Corporation Identification of null sets in a context-based electronic document search
US9460200B2 (en) 2012-07-02 2016-10-04 International Business Machines Corporation Activity recommendation based on a context-based electronic files search
US9262499B2 (en) 2012-08-08 2016-02-16 International Business Machines Corporation Context-based graphical database
US8676857B1 (en) 2012-08-23 2014-03-18 International Business Machines Corporation Context-based search for a data store related to a graph node
US8959119B2 (en) 2012-08-27 2015-02-17 International Business Machines Corporation Context-based graph-relational intersect derived database
US8620958B1 (en) 2012-09-11 2013-12-31 International Business Machines Corporation Dimensionally constrained synthetic context objects database
US9619580B2 (en) 2012-09-11 2017-04-11 International Business Machines Corporation Generation of synthetic context objects
US9251237B2 (en) 2012-09-11 2016-02-02 International Business Machines Corporation User-specific synthetic context object matching
US9223846B2 (en) 2012-09-18 2015-12-29 International Business Machines Corporation Context-based navigation through a database
US8782777B2 (en) 2012-09-27 2014-07-15 International Business Machines Corporation Use of synthetic context-based objects to secure data stores
US9741138B2 (en) 2012-10-10 2017-08-22 International Business Machines Corporation Node cluster relationships in a graph database
US9348677B2 (en) 2012-10-22 2016-05-24 Palantir Technologies Inc. System and method for batch evaluation programs
US8931109B2 (en) 2012-11-19 2015-01-06 International Business Machines Corporation Context-based security screening for accessing data
US8914413B2 (en) 2013-01-02 2014-12-16 International Business Machines Corporation Context-based data gravity wells
US8983981B2 (en) 2013-01-02 2015-03-17 International Business Machines Corporation Conformed dimensional and context-based data gravity wells
US9229932B2 (en) 2013-01-02 2016-01-05 International Business Machines Corporation Conformed dimensional data gravity wells
US9123086B1 (en) 2013-01-31 2015-09-01 Palantir Technologies, Inc. Automatically generating event objects from images
US8856946B2 (en) 2013-01-31 2014-10-07 International Business Machines Corporation Security filter for context-based data gravity wells
US9053102B2 (en) 2013-01-31 2015-06-09 International Business Machines Corporation Generation of synthetic context frameworks for dimensionally constrained hierarchical synthetic context-based objects
US9069752B2 (en) 2013-01-31 2015-06-30 International Business Machines Corporation Measuring and displaying facets in context-based conformed dimensional data gravity wells
US9292506B2 (en) 2013-02-28 2016-03-22 International Business Machines Corporation Dynamic generation of demonstrative aids for a meeting
US9110722B2 (en) 2013-02-28 2015-08-18 International Business Machines Corporation Data processing work allocation
US10037314B2 (en) 2013-03-14 2018-07-31 Palantir Technologies, Inc. Mobile reports
US8903717B2 (en) 2013-03-15 2014-12-02 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US10275778B1 (en) 2013-03-15 2019-04-30 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive investigation based on automatic malfeasance clustering of related data in various data structures
US8917274B2 (en) 2013-03-15 2014-12-23 Palantir Technologies Inc. Event matrix based on integrated data
US8909656B2 (en) 2013-03-15 2014-12-09 Palantir Technologies Inc. Filter chains with associated multipath views for exploring large data sets
US8868486B2 (en) 2013-03-15 2014-10-21 Palantir Technologies Inc. Time-sensitive cube
US8937619B2 (en) 2013-03-15 2015-01-20 Palantir Technologies Inc. Generating an object time series from data objects
US8930897B2 (en) 2013-03-15 2015-01-06 Palantir Technologies Inc. Data integration tool
US8855999B1 (en) 2013-03-15 2014-10-07 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US9965937B2 (en) 2013-03-15 2018-05-08 Palantir Technologies Inc. External malware data item clustering and analysis
US8818892B1 (en) 2013-03-15 2014-08-26 Palantir Technologies, Inc. Prioritizing data clusters with customizable scoring strategies
US10152526B2 (en) 2013-04-11 2018-12-11 International Business Machines Corporation Generation of synthetic context objects using bounded context objects
US8799799B1 (en) 2013-05-07 2014-08-05 Palantir Technologies Inc. Interactive geospatial map
US8831881B1 (en) 2013-05-15 2014-09-09 Google Inc. Interactive user interface for displaying available trips
US9348794B2 (en) 2013-05-17 2016-05-24 International Business Machines Corporation Population of context-based data gravity wells
US9195608B2 (en) 2013-05-17 2015-11-24 International Business Machines Corporation Stored data analysis
US9223773B2 (en) 2013-08-08 2015-12-29 Palatir Technologies Inc. Template system for custom document generation
US9335897B2 (en) 2013-08-08 2016-05-10 Palantir Technologies Inc. Long click display of a context menu
US8713467B1 (en) * 2013-08-09 2014-04-29 Palantir Technologies, Inc. Context-sensitive views
US9785317B2 (en) 2013-09-24 2017-10-10 Palantir Technologies Inc. Presentation and analysis of user interaction data
US8938686B1 (en) 2013-10-03 2015-01-20 Palantir Technologies Inc. Systems and methods for analyzing performance of an entity
US8812960B1 (en) 2013-10-07 2014-08-19 Palantir Technologies Inc. Cohort-based presentation of user interaction data
US9116975B2 (en) 2013-10-18 2015-08-25 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive simultaneous querying of multiple data stores
US8924872B1 (en) 2013-10-18 2014-12-30 Palantir Technologies Inc. Overview user interface of emergency call data of a law enforcement agency
US9021384B1 (en) 2013-11-04 2015-04-28 Palantir Technologies Inc. Interactive vehicle information map
US8832594B1 (en) 2013-11-04 2014-09-09 Palantir Technologies Inc. Space-optimized display of multi-column tables with selective text truncation based on a combined text width
US8868537B1 (en) 2013-11-11 2014-10-21 Palantir Technologies, Inc. Simple web search
US9105000B1 (en) 2013-12-10 2015-08-11 Palantir Technologies Inc. Aggregating data from a plurality of data sources
US9727622B2 (en) 2013-12-16 2017-08-08 Palantir Technologies, Inc. Methods and systems for analyzing entity performance
US9552615B2 (en) 2013-12-20 2017-01-24 Palantir Technologies Inc. Automated database analysis to detect malfeasance
US10356032B2 (en) 2013-12-26 2019-07-16 Palantir Technologies Inc. System and method for detecting confidential information emails
US9043696B1 (en) 2014-01-03 2015-05-26 Palantir Technologies Inc. Systems and methods for visual definition of data associations
US8832832B1 (en) 2014-01-03 2014-09-09 Palantir Technologies Inc. IP reputation
US9009827B1 (en) 2014-02-20 2015-04-14 Palantir Technologies Inc. Security sharing system
US9483162B2 (en) 2014-02-20 2016-11-01 Palantir Technologies Inc. Relationship visualizations
US9727376B1 (en) 2014-03-04 2017-08-08 Palantir Technologies, Inc. Mobile tasks
US8924429B1 (en) 2014-03-18 2014-12-30 Palantir Technologies Inc. Determining and extracting changed data from a data source
US9836580B2 (en) 2014-03-21 2017-12-05 Palantir Technologies Inc. Provider portal
US9857958B2 (en) 2014-04-28 2018-01-02 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive access of, investigation of, and analysis of data objects stored in one or more databases
US9009171B1 (en) 2014-05-02 2015-04-14 Palantir Technologies Inc. Systems and methods for active column filtering
US9619557B2 (en) 2014-06-30 2017-04-11 Palantir Technologies, Inc. Systems and methods for key phrase characterization of documents
US9535974B1 (en) 2014-06-30 2017-01-03 Palantir Technologies Inc. Systems and methods for identifying key phrase clusters within documents
US9202249B1 (en) 2014-07-03 2015-12-01 Palantir Technologies Inc. Data item clustering and analysis
US9256664B2 (en) 2014-07-03 2016-02-09 Palantir Technologies Inc. System and method for news events detection and visualization
US10572496B1 (en) 2014-07-03 2020-02-25 Palantir Technologies Inc. Distributed workflow system and database with access controls for city resiliency
US9021260B1 (en) 2014-07-03 2015-04-28 Palantir Technologies Inc. Malware data item analysis
US9785773B2 (en) 2014-07-03 2017-10-10 Palantir Technologies Inc. Malware data item analysis
US10402067B2 (en) * 2014-08-01 2019-09-03 Autodesk, Inc. Bi-directional search and sorting
US9454281B2 (en) 2014-09-03 2016-09-27 Palantir Technologies Inc. System for providing dynamic linked panels in user interface
US9767172B2 (en) 2014-10-03 2017-09-19 Palantir Technologies Inc. Data aggregation and analysis system
US9501851B2 (en) 2014-10-03 2016-11-22 Palantir Technologies Inc. Time-series analysis system
US9785328B2 (en) 2014-10-06 2017-10-10 Palantir Technologies Inc. Presentation of multivariate data on a graphical user interface of a computing system
US9984133B2 (en) 2014-10-16 2018-05-29 Palantir Technologies Inc. Schematic and database linking system
US9229952B1 (en) 2014-11-05 2016-01-05 Palantir Technologies, Inc. History preserving data pipeline system and method
US9043894B1 (en) 2014-11-06 2015-05-26 Palantir Technologies Inc. Malicious software detection in a computing system
US9348920B1 (en) 2014-12-22 2016-05-24 Palantir Technologies Inc. Concept indexing among database of documents using machine learning techniques
US9367872B1 (en) 2014-12-22 2016-06-14 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive investigation of bad actor behavior based on automatic clustering of related data in various data structures
US10362133B1 (en) 2014-12-22 2019-07-23 Palantir Technologies Inc. Communication data processing architecture
US10552994B2 (en) 2014-12-22 2020-02-04 Palantir Technologies Inc. Systems and interactive user interfaces for dynamic retrieval, analysis, and triage of data items
US9335911B1 (en) 2014-12-29 2016-05-10 Palantir Technologies Inc. Interactive user interface for dynamic data analysis exploration and query processing
US9817563B1 (en) 2014-12-29 2017-11-14 Palantir Technologies Inc. System and method of generating data points from one or more data stores of data items for chart creation and manipulation
US9870205B1 (en) 2014-12-29 2018-01-16 Palantir Technologies Inc. Storing logical units of program code generated using a dynamic programming notebook user interface
US10372879B2 (en) 2014-12-31 2019-08-06 Palantir Technologies Inc. Medical claims lead summary report generation
US11302426B1 (en) 2015-01-02 2022-04-12 Palantir Technologies Inc. Unified data interface and system
US10387834B2 (en) 2015-01-21 2019-08-20 Palantir Technologies Inc. Systems and methods for accessing and storing snapshots of a remote application in a document
US9727560B2 (en) 2015-02-25 2017-08-08 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
EP3611632A1 (en) 2015-03-16 2020-02-19 Palantir Technologies Inc. Displaying attribute and event data along paths
US9886467B2 (en) 2015-03-19 2018-02-06 Plantir Technologies Inc. System and method for comparing and visualizing data entities and data entity series
US10628834B1 (en) 2015-06-16 2020-04-21 Palantir Technologies Inc. Fraud lead detection system for efficiently processing database-stored data and automatically generating natural language explanatory information of system results for display in interactive user interfaces
US9418337B1 (en) 2015-07-21 2016-08-16 Palantir Technologies Inc. Systems and models for data analytics
US9454785B1 (en) 2015-07-30 2016-09-27 Palantir Technologies Inc. Systems and user interfaces for holistic, data-driven investigation of bad actor behavior based on clustering and scoring of related data
US9996595B2 (en) 2015-08-03 2018-06-12 Palantir Technologies, Inc. Providing full data provenance visualization for versioned datasets
US9456000B1 (en) 2015-08-06 2016-09-27 Palantir Technologies Inc. Systems, methods, user interfaces, and computer-readable media for investigating potential malicious communications
US10489391B1 (en) 2015-08-17 2019-11-26 Palantir Technologies Inc. Systems and methods for grouping and enriching data items accessed from one or more databases for presentation in a user interface
US9600146B2 (en) 2015-08-17 2017-03-21 Palantir Technologies Inc. Interactive geospatial map
US10102369B2 (en) 2015-08-19 2018-10-16 Palantir Technologies Inc. Checkout system executable code monitoring, and user account compromise determination system
US10853378B1 (en) 2015-08-25 2020-12-01 Palantir Technologies Inc. Electronic note management via a connected entity graph
US11150917B2 (en) 2015-08-26 2021-10-19 Palantir Technologies Inc. System for data aggregation and analysis of data from a plurality of data sources
US9485265B1 (en) 2015-08-28 2016-11-01 Palantir Technologies Inc. Malicious activity detection system capable of efficiently processing data accessed from databases and generating alerts for display in interactive user interfaces
US10706434B1 (en) 2015-09-01 2020-07-07 Palantir Technologies Inc. Methods and systems for determining location information
US9576015B1 (en) 2015-09-09 2017-02-21 Palantir Technologies, Inc. Domain-specific language for dataset transformations
US10296617B1 (en) 2015-10-05 2019-05-21 Palantir Technologies Inc. Searches of highly structured data
US9542446B1 (en) 2015-12-17 2017-01-10 Palantir Technologies, Inc. Automatic generation of composite datasets based on hierarchical fields
US9823818B1 (en) 2015-12-29 2017-11-21 Palantir Technologies Inc. Systems and interactive user interfaces for automatic generation of temporal representation of data objects
US10089289B2 (en) 2015-12-29 2018-10-02 Palantir Technologies Inc. Real-time document annotation
US9612723B1 (en) 2015-12-30 2017-04-04 Palantir Technologies Inc. Composite graphical interface with shareable data-objects
US10698938B2 (en) 2016-03-18 2020-06-30 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US10719188B2 (en) 2016-07-21 2020-07-21 Palantir Technologies Inc. Cached database and synchronization system for providing dynamic linked panels in user interface
US10324609B2 (en) 2016-07-21 2019-06-18 Palantir Technologies Inc. System for providing dynamic linked panels in user interface
US10437840B1 (en) 2016-08-19 2019-10-08 Palantir Technologies Inc. Focused probabilistic entity resolution from multiple data sources
US10318630B1 (en) 2016-11-21 2019-06-11 Palantir Technologies Inc. Analysis of large bodies of textual data
US10460602B1 (en) 2016-12-28 2019-10-29 Palantir Technologies Inc. Interactive vehicle information mapping system
CN110312974B (en) * 2017-02-20 2023-08-22 西门子股份公司 Programming in simulation for process industry
US10956406B2 (en) 2017-06-12 2021-03-23 Palantir Technologies Inc. Propagated deletion of database records and derived data
US10403011B1 (en) 2017-07-18 2019-09-03 Palantir Technologies Inc. Passing system with an interactive user interface
US11599369B1 (en) 2018-03-08 2023-03-07 Palantir Technologies Inc. Graphical user interface configuration system
US10754822B1 (en) 2018-04-18 2020-08-25 Palantir Technologies Inc. Systems and methods for ontology migration
US10885021B1 (en) 2018-05-02 2021-01-05 Palantir Technologies Inc. Interactive interpreter and graphical user interface
US11119630B1 (en) 2018-06-19 2021-09-14 Palantir Technologies Inc. Artificial intelligence assisted evaluations and user interface for same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0568103A2 (en) * 1992-04-30 1993-11-03 Olympus Optical Co., Ltd. Data managing apparatus for an open system
US20020077844A1 (en) * 2000-10-31 2002-06-20 Cmc Corporation Component-description-manual creation support method, component-description-manual creation support system, and computer-readable recording medium
US20080222568A1 (en) * 2007-03-08 2008-09-11 Fujitsu Limited Program, method and system for selecting the three-dimensional model of a component
US20090313215A1 (en) * 2005-12-05 2009-12-17 Oneimage, Llc System for Integrated Utilization of Data to Identify, Characterize, and Support Successful Farm and Land Use Operations

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3621214A (en) * 1968-11-13 1971-11-16 Gordon W Romney Electronically generated perspective images
US7098392B2 (en) * 1996-07-10 2006-08-29 Sitrick David H Electronic image visualization system and communication methodologies
US6630937B2 (en) * 1997-10-30 2003-10-07 University Of South Florida Workstation interface for use in digital mammography and associated methods
US6161051A (en) * 1998-05-08 2000-12-12 Rockwell Technologies, Llc System, method and article of manufacture for utilizing external models for enterprise wide control
JP2005004489A (en) * 2003-06-12 2005-01-06 Toyota Industries Corp Device and program for creating component catalog
US7664739B2 (en) * 2006-02-14 2010-02-16 Microsoft Corporation Object search ui and dragging object results
JP2007219907A (en) * 2006-02-17 2007-08-30 Ricoh Co Ltd Parts catalog system, parts catalog creation method, program, and recording medium
US9448705B2 (en) * 2007-11-05 2016-09-20 Trimble Navigation Limited Configuring graphical displays
EP2223245B1 (en) * 2007-11-30 2011-07-20 Coventor, Inc. System and method for three-dimensional schematic capture and result visualization of multi-physics system models
US9584710B2 (en) * 2008-02-28 2017-02-28 Avigilon Analytics Corporation Intelligent high resolution video system
WO2009134755A2 (en) * 2008-04-28 2009-11-05 Alexandria Investment Research And Technology, Llc Adaptive knowledge platform
JP5532352B2 (en) * 2009-02-20 2014-06-25 サンパワー コーポレイション Method and program for designing a solar collector installation
US9195898B2 (en) * 2009-04-14 2015-11-24 Qualcomm Incorporated Systems and methods for image recognition using mobile devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0568103A2 (en) * 1992-04-30 1993-11-03 Olympus Optical Co., Ltd. Data managing apparatus for an open system
US20020077844A1 (en) * 2000-10-31 2002-06-20 Cmc Corporation Component-description-manual creation support method, component-description-manual creation support system, and computer-readable recording medium
US20090313215A1 (en) * 2005-12-05 2009-12-17 Oneimage, Llc System for Integrated Utilization of Data to Identify, Characterize, and Support Successful Farm and Land Use Operations
US20080222568A1 (en) * 2007-03-08 2008-09-11 Fujitsu Limited Program, method and system for selecting the three-dimensional model of a component

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2689358A4 *

Also Published As

Publication number Publication date
EP2689358A1 (en) 2014-01-29
CN103443793A (en) 2013-12-11
CA2829636A1 (en) 2012-09-27
BR112013023546A2 (en) 2016-12-06
KR20140002750A (en) 2014-01-08
EP2689358A4 (en) 2014-12-10
AU2012231129A1 (en) 2013-09-19
US20120246148A1 (en) 2012-09-27

Similar Documents

Publication Publication Date Title
US20120246148A1 (en) Contextual Display and Scrolling of Search Results in Graphical Environment
US11449202B1 (en) User interface and method of data navigation in the user interface of engineering analysis applications
KR101512084B1 (en) Web search system for providing 3 dimensional web search interface based virtual reality and method thereof
JP6018045B2 (en) Temporary formatting and graphing of selected data
US8230339B2 (en) Hierarchical data display
US20150378529A1 (en) Interaction in orbit visualization
KR20160013901A (en) Web browser history
US20120254792A1 (en) Method And System For Providing An HMI In A Process Control System For Monitoring And Control Of A Process
WO1997045779A1 (en) Methods and systems for document management in industrial process control systems
Lam et al. A guide to visual multi-level interface design from synthesis of empirical study evidence
Bennett et al. Visual momentum redux
US10216363B2 (en) Navigating a network of options
EP3227767B1 (en) Hierarchical navigation apparatus and method
US20120036465A1 (en) Supervisory control system for controlling a technical system, a method and computer program products
Conversy et al. Improving modularity of interactive software with the MDPC architecture
Wiese et al. Graph drawing tools for bioinformatics research: An overview
Carley ORA: Quick Start Guide
CN117667062A (en) Development system and development method for man-machine interaction interface of flight cockpit
Thiel et al. Visualizing software variability
Gundelsweiler et al. Advanced user interfaces for product management systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12761409

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012761409

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2829636

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2012231129

Country of ref document: AU

Date of ref document: 20120320

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20137025737

Country of ref document: KR

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112013023546

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112013023546

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20130913