WO2018080616A1 - Intégration de fichiers cad dans des modèles sémantiques et visualisation de données liées dans un environnement 3d - Google Patents

Intégration de fichiers cad dans des modèles sémantiques et visualisation de données liées dans un environnement 3d Download PDF

Info

Publication number
WO2018080616A1
WO2018080616A1 PCT/US2017/046890 US2017046890W WO2018080616A1 WO 2018080616 A1 WO2018080616 A1 WO 2018080616A1 US 2017046890 W US2017046890 W US 2017046890W WO 2018080616 A1 WO2018080616 A1 WO 2018080616A1
Authority
WO
WIPO (PCT)
Prior art keywords
cad
data
linked
virtual
knowledge
Prior art date
Application number
PCT/US2017/046890
Other languages
English (en)
Inventor
Mareike KRITZLER
Matthias Mayr
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Publication of WO2018080616A1 publication Critical patent/WO2018080616A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Definitions

  • the present embodiments relate to methods and systems for integrating CAD files and data into semantic models and visualizing linked data in a three- dimensional (3D) environment.
  • Semantic Technologies are a powerful tool to describe and give meaning to existing data models.
  • Data models can be described as semantic models / knowledge models/ ontologies that include relationships among the models.
  • the ontologies are often made publicly available, and the knowledge is readable by humans and machines using the structured descriptions.
  • the models can be linked to each other and knowledge can be extracted from the ontologies.
  • computer-aided design (CAD) programs and CAD files do not semantically describe CAD data and the CAD data is not linked to existing ontologies.
  • CAD data is extracted from CAD files based on mapping the CAD file format to a semantic model (CAD ontology).
  • the extracted CAD data is linked to existing knowledge models using properties associated with the ontology, enhancing the CAD data and providing for relationships between the extracted CAD data and existing knowledge models to be displayed in a virtual 3D environment.
  • Knowledge linked to the CAD file is displayed, allowing a user to explore links between different knowledge models by interactively moving through the linked data in the 3D environment, such as using virtual, augmented, or mixed reality.
  • a method for linking CAD data to other existing knowledge models and displaying linked data in a virtual 3D environment.
  • the method includes defining a semantic model for CAD files.
  • the semantic model includes a model for the CAD file and properties of the CAD file.
  • the method includes mapping attributes of a CAD file format to a semantic model in the knowledge repository and linking CAD attributes to existing knowledge models in the knowledge repository.
  • the method also includes accessing the existing knowledge from the knowledge repository based on the linked CAD data and displaying semantic relationships between the linked CAD data and the accessed existing knowledge from the knowledge repository in the virtual 3D environment.
  • a method for integrating CAD file data into a knowledge repository using the semantic model.
  • the method includes parsing a CAD file based on the semantic CAD model and linking the parsed properties of the CAD file to properties of existing semantic models.
  • the method may also include displaying the parsed properties of the CAD file with semantic connections to instances from linked knowledge models.
  • a system for visualizing linked data in a virtual 3D environment includes a user interface configured to recognize user gestures and to display the virtual 3D environment, and a renderer configured to receive data linked using a semantic model.
  • the linked data includes structural data (e.g. geometric data) and metadata from a CAD file.
  • the renderer is also configured to receive a gesture input requesting display of the linked data from the user interface and to render the virtual 3D environment based on the linked data.
  • the rendered virtual 3D environment depicts the linked data connected to related knowledge according to the semantic model.
  • Figure 1 illustrates an embodiment of an architecture for integrating CAD data to semantic technologies and semantic browsing in three dimensions.
  • Figure 2 illustrates a portion of an example data ontology of a CAD file.
  • Figures 3A-3B illustrate an embodiment of displaying CAD data in an instance level and a schema level.
  • Figure 4 illustrates an embodiment of displaying ontology information for linked data in a mixed reality environment.
  • Figure 5 illustrates an embodiment of a display path / history of ontology information for linked information sources.
  • Figure 6 illustrates an embodiment of an information center display for linked information sources.
  • Figure 7 illustrates a flow chart diagram of one embodiment of a method for linking CAD data to a knowledge repository and displaying linked data in a virtual 3D environment.
  • Figure 8 illustrates a flow chart diagram of one embodiment of a method for integrating CAD files with semantic technologies.
  • Figure 9 illustrates an embodiment of a system for visualizing linked data in a virtual 3D environment.
  • the present embodiments address the problem of limited functional interoperability of CAD programs (e.g., NX, AutoCAD, etc.) with existing data models and missing links between existing data sources and CAD file formats (e.g., JT files, DWG files, etc.) using semantic technologies.
  • semantic technologies use semantic / knowledge models to provide for a variety of linked information sources that are machine and human readable and that provide knowledge based on relationships between information sources.
  • the CAD file data is enhanced with additional knowledge (e.g., standards, regulations, functional specifications, etc.) based on the information linked to the CAD files.
  • CAD program users may change CAD data properties and functional attributes of the CAD files in an immersive 3D display environment displaying the linked information sources, and the changes are reflected in the modeled components or parts represented by the CAD files.
  • the CAD data and linked data is displayed in the 3D environment without further implementation required in the CAD program.
  • the present embodiments provide for the data structure and connections of linked data using semantic technologies to be visualized (e.g., displayed) and explored in a 3D environment, including attributes of a CAD file linked to the existing information using semantic technologies based on existing semantic models.
  • linked data about a specific part of a CAD model may be visualized in a 3D environment showing other knowledge linked to the CAD information.
  • the CAD property data for the part of the CAD model may be modified in the 3D environment based on the linked data.
  • attributes of the CAD data may be modified based on knowledge queried from linked data using the semantic models and/or based on user input.
  • a unit of measurement associated with the CAD data is converted using conversion factors queried from the semantic models (e.g., converting mass from kilograms to ounces).
  • a material, color or other property of the CAD model extracted from the CAD file may be modified (e.g., a color property of a material is changed in the underlying knowledge model) in the 3D environment. Modifications and changes to the CAD property data is automatically visible in the 3D representation of the CAD model (e.g., that used this property).
  • Other use-cases for displaying and modifying CAD data linked to a knowledge model may be implemented.
  • Figure 1 illustrates an embodiment of an architecture for integrating CAD data with semantic technologies and semantic browsing in three-dimensions.
  • the exemplary architecture includes the knowledge repository 101, renderer 103, a user interface 105 and a CAD (here a JT file) file 107.
  • the knowledge repository 101 integrates and represents information from a CAD file 107 and connects CAD file data (e.g., mass data) to other existing information sources (e.g., units, properties, files, etc.).
  • CAD file data e.g., mass data
  • other existing information sources e.g., units, properties, files, etc.
  • the renderer 103 receives semantic knowledge from the knowledge repository 101, receives geometric information from the CAD file 107, and receives process gesture inputs from the user interface 105 to generate (e.g., render) a visual output (e.g., a video stream) in three dimensions for viewing on the user interface 105.
  • the user interface 105 receives the generated video stream from the renderer 103 and displays the video stream as a virtual 3D environment.
  • the user interface 105 captures gestures and/or other inputs from a user for exploring and interacting with the virtual 3D environment.
  • the user interface 105 is a smartphone or other device capable of receiving user input (e.g., gesture recognition) and producing a 3D visualization based on the received video stream.
  • the CAD file 107 e.g., a JT file, AutoCAD file, etc.
  • the exemplary architecture may include a geometric converter 109.
  • the geometric conversion performed by geometric converter 109 may be performed by the renderer 103.
  • the geometric conversion generates a 3D model from the CAD file 107 for use by the renderer 103.
  • CAD tools do not integrate CAD data in semantic models from curated repositories.
  • CAD tools use proprietary descriptions and datatypes for common knowledge (e.g., mass units in kilograms, etc.) in the proprietary CAD file formats.
  • the proprietary descriptions and datatypes limit interoperability of the CAD files in semantic models and increases the effort required to represent and display the common knowledge.
  • the present embodiments provide for integrating CAD data into the knowledge repository, linking the CAD data to existing knowledge in the knowledge repository, enriching the CAD data (e.g., with standards data, regulatory data, engineering specifications, etc.).
  • Figure 2 illustrates a portion of an example ontology of the CAD file format JT.
  • the portion of the CAD file is displayed as a modeled CAD ontology showing basic relationships within the JT file format.
  • the basic relationships include objects (e.g., data parts), the object types, and parent/child relationships between objects (e.g., classes, subclasses, etc.).
  • the objects include design data for the CAD model (e.g., characteristics of the model, such as a mass of a part or component, etc.) and metadata (e.g., the designer of a CAD model, etc.).
  • CAD file formats e.g., JT files, DWG files, etc.
  • One or more of the present embodiments semantically describe the CAD file format (e.g., the objects, parts, relationships, metadata, etc.) to provide links to existing information sources according to a semantic model.
  • a partial or complete semantic description of the CAD file format is provided for linking CAD files of the CAD file format ontology to the other available semantic models.
  • the semantic description is provided by evaluating the CAD file format and identifying attributes (e.g., a class and properties) that can correspond to existing semantic models.
  • the CAD file format is translated into an ontology and attributes of ontology are identified that correspond to attributes of existing semantic models. The corresponding attributes of ontology are used to link CAD files to other knowledge models.
  • CAD files are linked based on the generated ontology. For example, a CAD file is parsed using the ontology for the CAD file format. Using the CAD data parsed and extracted from the CAD file, the CAD file is semantically described and linked to the other existing information sources. Properties of the CAD file are mapped to properties of other existing semantic models and the properties are made available as linked data. Linking CAD files to the available knowledge models allows for users to access and to explore publicly available knowledge repositories that relate to properties of the CAD file, enhancing the CAD file with additional information from the repositories.
  • the CAD files may be linked to any available semantic model (e.g., Quantities, Units, Dimensions and Types (QUDT) for units, Schema.org for nodes/entities, DBepedia for knowledge,
  • QUDT Quantities, Units, Dimensions and Types
  • CAD files By linking to available knowledge models, designers of CAD programs do not have to model information stored in the CAD files or rely on a proprietary information model for the CAD program. Connecting CAD files with existing information sources allows for interoperability of the CAD files and the reuse of existing information models, providing access to the other information linked to the information models.
  • users of CAD programs link CAD files to existing knowledge models. For example, users of CAD programs see how attributes of the CAD files are linked to other existing information sources, and may reuse existing knowledge from the knowledge repositories (e.g., unit conversions, material properties, etc.).
  • CAD files contain typically geometric data with metadata
  • the CAD files are enhanced with additional information from the repositories.
  • a CAD file models and represents the geometric attributes of components of an automobile, and by linking additional data to the CAD file, additional attributes of the components may be utilized.
  • the geometric attributes of the tires for the automobile are linked to other design attributes of the tires, such as noise level, rubber material properties, traction characteristics, speed ratings, tire manufacturer information, etc.
  • Other attributes of the CAD file are similarly liked to existing knowledge in the repositories.
  • visualization tools display the linked data and semantic models as connected nodes (e.g., web browser tool WebVOWL).
  • Other development environments show data in tabular views and provide hyperlinks to switch between data nodes (e.g., TopBraid Composer).
  • Existing 3D graph visualization tools do not display ontologies and do not provide for a 3D environment allowing for users to interact with and move through ontologies.
  • the 3D graph visualization tools are not designed to be used in a virtual, augmented, or mixed reality application.
  • the linked data is displayed in a virtual 3D environment.
  • the virtual 3D environment allows a user to visualize and intuitively explore the linked data of an underlying knowledge model.
  • existing ontologies and the semantically described CAD information is displayed in a 3D environment by creating nodes and connecting the nodes with lines indicating relationships between the nodes. Based on attributes and data types of the nodes, different nodes of the ontologies are displayed with different shapes as 3D objects in the 3D environment and are connected to other associated nodes.
  • the 3D environment allows users to interact with linked data. For example, users may explore the connected ontologies in an immersive manner to visualize which nodes of the linked data have connections to other nodes and information sources. Users can explore the 3D environment using virtual, mixed, or augmented reality display devices.
  • custom-made visualizations are provided for specific use-cases, such as a unit conversion tool, a CAD property conversion tool, a repository manipulation tool, etc.
  • the custom-made visualization tools query information from the semantic model and display the information for user visualization and interaction.
  • a unit conversion tool is provided to convert units from the CAD file based on conversion rates queried from the knowledge model (e.g., converting mass from kilograms to ounces).
  • a CAD property conversion tool is provided to convert properties of the CAD file based on a user input (e.g., converting a material color of a product component in the CAD file).
  • a repository manipulation tool is provided for the user to update the knowledge repository of connected information and/or the underlying semantic model to link or unlink information sources in the information model.
  • Other additional and different visualizations and tools may be provided.
  • the custom- made visualizations and tools are provided to the user via the virtual 3D environment with an augmented or virtual reality display device.
  • users may visualize and interact with any linked information sources in the virtual 3D environment to access and explore the linked data using a virtual, augmented, or mixed reality devices.
  • Visualizing and interacting with the linked data provides users access to large knowledge repositories and displays connections between data from the knowledge repositories and the linked CAD file.
  • the visualizations and interactions allows users to better understand semantic relationships of the linked data and lowers the hurdle for non-experts to understand the structure and metadata of the CAD file and related information linked to attributes of the CAD file.
  • users may revert back to a starting point or a previous point within the semantic model to reduce the amount of information that is displayed in the virtual 3D environment.
  • Figures 3A-3B illustrate an embodiment of displaying CAD data in an instance level and a schema level.
  • the virtual 3D environment displays each node representing concepts of the ontology and instances by separating the vocabulary from the schema level.
  • the resulting visualization is divided in two levels.
  • the upper instance / vocabulary level shows the data instances of a currently displayed CAD file.
  • the lower schema / concept level shows the underlying schema of the information ontology displaying connections of the instance of the CAD file to other information sources.
  • Figure 3B identifies the displayed components of the semantic model associated with the value of the instance of a CAD file.
  • GMO00026-V represents an instance of the CAD file linked within the knowledge repository, such as a part or component of a product modeled in the CAD file. All nodes are connected by properties. Properties can also connect to literals. Property 'ID' connects to the literal 96046 from the CAD file. Additional characteristics of the CAD file may be displayed, such as the attribute of 'has mass'. Property 'has mass' connects to a blank node (a node that contains information but no URI (Uniform Resource Identifier)). Instance and schema nodes are connected through property 'type of . The schema node JT part is depicted on the schema level and includes additional characteristics of the node within the information ontology (e.g., comments, etc.).
  • the instance node and schema node both indicate that the nodes include four triples associated with the nodes.
  • Semantic triples are a set of data entities codifying a statement about semantic data in a subject-predicate-object expression or statement.
  • the number of triples depicts the amount of information that is behind each node. This information can be queried. Additional and different components may be included in an instance and displayed in the virtual 3D environment.
  • Displaying the CAD information according to the semantic model may be facilitated using virtual reality, mixed reality or augmented reality.
  • the ontology visualization is provided as a virtual reality environment.
  • figure 4 illustrates an embodiment of displaying ontology information for linked information sources in a mixed reality environment (e.g., augmented reality).
  • the ontology visualization may be provided using a mixed reality device (e.g., Microsoft HoloLens, etc.) and depicts the CAD information mixed within a real world image displayed to the user.
  • the CAD information is superimposed over the environment in front of the user (e.g., an office environment, etc.). The user may interact with the mixed reality environment using hand gestures, a gesture sensor, etc.
  • a path /display history is visualized.
  • figure 5 illustrates an embodiment of a path / display history of ontology information for linked information sources.
  • the historical path of a user moving through the linked information sources is displayed in a virtual reality environment.
  • the user started with instance node GMO00026-VOC through the link (property) type to the schema node JT part for the instance node.
  • the user explored linked schema nodes, from JT part to JT Unit to JT Hierarchy to JT Object to CAD Object.
  • the user explores the instance node for the CAD Object to display information stored in the instance node.
  • the path of the user through the information sources is highlighted to keep track of the history and to depict the nodes accessed by the user during exploration. Further, during exploration of the linked data, users may revert back to a starting point or a previous point within the semantic model to reduce the amount of information that is displayed in the virtual 3D environment (e.g., hiding the historical display).
  • the virtual 3D environment is provided as a two story view.
  • the top story displays the 3D CAD model from the linked CAD file.
  • the user may explore the CAD model in three dimensions, such as by manipulating the model, hiding components of the model and picking a component of the model for further examination using drag, fly, point and other gestures.
  • the user may interact with the CAD model using a menu of options and using gestures associated with the selected options from the menu.
  • the bottom story of the two story view is an information interface for displaying information linked to components of the CAD model. For example, when the user selects a component of the CAD model using a pick and examine option from the menu, the component is displayed in the information center with options for exploring information associated with the component.
  • Figure 6 illustrates an embodiment of an information center display for linked information sources.
  • the selected component of the CAD model is displayed in the center of the 3D information center display.
  • the information center display displays boards or other interfaces surrounding the component.
  • the boards and/or interfaces display information associated with the CAD file, tools available to the user (e.g., mass conversion, etc.), interfaces for exploring data sources linked to the component of the model, etc.
  • Other boards and/or interfaces may be provided.
  • a Part Info board is provided to display information associated with the component selected for exploration.
  • the Part Info board depicted in figure 6 displays the instance node (e.g., Part Name: GMO00026-VOC), the mass associated with the instance node (e.g., Mass: 568.333 kg) and the literal value of the instance node from the CAD file (e.g., ID: 96046).
  • the list of the instance nodes from the CAD file are displayed and may be selected by the user.
  • the list of instance nodes is displayed as a hierarchical part list.
  • Figure 6 also displays an embodiment of a mass unit conversion tool displayed on a board of the information center display.
  • a user may change the units associated with the component in the CAD file.
  • the Mass Conversion board displayed in the information center a user may convert the units associated with the component.
  • the user selects a new unit for the mass of the component from the available units displayed on the Mass Conversion board.
  • the conversion for the mass conversion factors are queried from the linked information sources, such as from an existing Quantities, Units, Dimensions and Types (QUDT).
  • the converted units are used to update the displayed value of the property of the CAD file, and the currently active unit is highlighted on the Mass Conversion board and the mass value in that unit is displayed on the Part Info board.
  • Figure 6 also displays an embodiment of an interface for exploring information linked to the selected component.
  • an Explore Linked Data portal is depicted as a visual entry point to explore the linked data sources. The user may select to enter the portal to explore and access additional nodes and
  • CAD program developers may keep using the descriptions within the CAD file for use in the virtual 3D environment. For example, two dimensional visualizations of the CAD data are displayed by placing the CAD data on a wall or a board in the virtual 3D environment. This embodiment would facilitate displaying the CAD data in the virtual 3D environment, but does not make use of the 3rd dimension for an immersive experience allowing users explore linked data to the CAD files.
  • Figure 7 illustrates a flow chart diagram of one embodiment of a method for linking CAD data to a knowledge repository and displaying linked data in a virtual 3D environment.
  • the method is implemented by the system of figure 1, figure 9 (discussed below) and/or a different system. Additional, different or fewer acts may be provided. For example, acts 707 and 709 may be omitted if the linked CAD files are not displayed or modified. The method is provided in the order shown. Other orders may be provided and/or acts may be repeated. For example, acts 707 and 709 may be repeated for a plurality of displays and for a plurality of modifications to the CAD file and/or knowledge model.
  • mapping the CAD file format includes semantically describing the attributes of the CAD file format. For example, for a CAD model of an automobile, a CAD attribute "wheel” for the wheel of the automobile is mapped as a type "JT Part" in the knowledge model for the repository. Each instance, or a subset of the data instances, of the CAD file format is mapped with a type to the knowledge model.
  • Existing or established vocabularies for the knowledge model are used to build on existing knowledge repositories and to use both common and unique identifiers to describe the CAD data.
  • the existing and established vocabularies are machine readable, and based on the information model, existing data in the repository may be automatically identified for linking to a CAD file based on the mapped CAD file format.
  • an ontology is generated for the CAD file format based on the mapped attributes of the CAD file format to the knowledge model.
  • CAD data from a CAD file is linked to existing data in the knowledge repository.
  • the CAD data is linked based on the mapped attributes of the CAD file format.
  • linking the CAD data includes linking the mass of a part to the existing data in the knowledge repository (see QUDT).
  • Any relevant knowledge model may be linked to the CAD data, such as standards data, regulatory data, engineering specification data, etc. Other types of data may also be linked, such as manufacturing data, supplier data, and other data to enhance the CAD data from additional information sources.
  • existing data from the knowledge repository is accessed. For example, based on the linked CAD data, existing data from the additional sources is accessed to enhance the CAD data for display in a virtual 3D environment. Accessing the existing data may include opening and downloading files from different knowledge repositories (e.g., knowledge server, etc.), and extracting relevant data from the files for use with the CAD data.
  • knowledge repositories e.g., knowledge server, etc.
  • semantic relationships between the linked CAD data and the accessed existing data from the knowledge repository are displayed in a virtual 3D environment.
  • displaying the semantic relationships includes displaying an instance of the CAD data (e.g., a component of the CAD model) and an underlying schema of connections of the CAD data to the accessed data from the knowledge repository.
  • the semantic relationships are displayed as a 3D data ontology allowing the user to visualize and explore data connection.
  • the displayed virtual 3D environment is provided with a virtual, augmented, or mixed reality display providing for an immersive experience to the user.
  • a user input is received to interact with the linked data.
  • the user input may be received as a command to display knowledge associated with the CAD file, a command from a tool available to the user to display or modify the displayed data (e.g., mass conversion, etc.), a command from an interface for exploring data sources linked to the component of the model, etc.
  • the CAD data may be displayed or modified, such as by converting a unit of the linked CAD data, changing a material or other property within the CAD displayed data, linking the CAD data to additional knowledge sources, etc. Modifications to the linked data in the virtual 3D environment update the knowledge repository associated with the linked data, such as saving the
  • Figure 8 illustrates a flow chart diagram of one embodiment of a method for integrating computer-aided design (CAD) files into a knowledge repository using a semantic model.
  • the method is implemented by the system of figure 1, figure 9 (discussed below) and/or a different system. Additional, different or fewer acts may be provided. For example, acts 807 and 809 may be omitted if the linked CAD files are not displayed or modified. The method is provided in the order shown. Other orders may be provided and/or acts may be repeated. For example, acts 807 and 809 may be repeated for a plurality of displays and for a plurality of modifications to the knowledge repository.
  • CAD data files are used to define the semantic model / ontology.
  • Semantic descriptions such as class and properties, are defined based on the properties of the CAD file.
  • CAD files may be incorporated into existing knowledge repositories, searched and linked to other knowledge sources.
  • the CAD file semantic model / ontology enables the linked CAD files to be both machine readable and readable by a user.
  • a CAD file is parsed for properties of the CAD file based on the CAD file semantic model / ontology. Based on the CAD file semantic model / ontology, properties of the CAD file are extracted from the CAD file. For example, parsing the CAD file translates the CAD file into an instance and extracts properties of the CAD file based on the CAD file semantic model / ontology. Based on the CAD file semantic model / ontology, all or a selected portion of the CAD data may be extracted from the CAD file.
  • the parsed properties of the CAD file are linked to an knowledge repository of the semantic technologies.
  • the extracted properties of the CAD file is linked to the knowledge repository based on the properties of the semantic model. For example, linking the parsed properties of the CAD file links geometric data of the CAD file to material properties or functional requirements from the knowledge repository based on the same or similar properties used to link the additional knowledge to the semantic technologies. Linking the properties of the CAD file to the database may also make the CAD data searchable within the knowledge repository.
  • the parsed properties of the CAD file are displayed with semantic connections to data from a linked knowledge repository.
  • the parsed properties of the CAD file are displayed in a virtual 3D environment in virtual reality, mixed reality, or augmented reality.
  • the 3D model of the CAD file may be displayed along with an information center for exploring data connected to different components of the 3D model.
  • the 3D environment allows for exploring the semantic models / ontologies associated with the linked data in in virtual, mixed, or augmented reality.
  • a request is received to interact with the displayed semantic relationships. For example, a user requests to interact with the virtual 3D
  • the request may include a request to explore connections in the virtual 3D environment in virtual, mixed, or augmented reality.
  • the request may include a request to modify the CAD file data based on an input from a user interface, such as to change an attribute within the CAD file.
  • Virtual, augmented and mixed reality devices provide computer-simulated environments or augment existing objects in a machine-captured environment for display to users by using a headset.
  • virtual reality devices include the HTC Vive, etc.
  • mixed reality devices include the Microsoft HoloLens, etc.
  • the headsets typically include a screen for each eye and track the movements of the head with an inertial measurement unit (IMU) sensor.
  • IMU inertial measurement unit
  • Figure 9 illustrates an embodiment of a system for visualizing linked data in a virtual 3D environment.
  • the system 900 allows for display and user interaction with linked data in the virtual 3D environment by the user interface 909.
  • the system 900 may be provided in conjunction with a cloud-based or local server for hosting the linked data and an engineering workstation 919 for generating and storing a CAD file.
  • the system may include one or more server 905, one or more network 903 and/or one or more workstation 919. Additional, different, or fewer components may be provided.
  • the server 905 and the workstation 919 are directly connected, or implemented on a single computing device.
  • the user interface 909 is provided for visualizing linked data in a virtual 3D environment.
  • the user interface 909 includes a display device 911, memory 913, hardware processor 915 and a sensor 917. Additional, different, or fewer
  • the user interface 909 is a virtual, augmented, or mixed reality device, such as a VR headset.
  • the user interface 909 is a smartphone that works in conjunction with a headset.
  • Other VR and AR devices may be provided.
  • the user interface 909 is configured to recognize user gestures via sensor 917 and to display the virtual 3D environment via the display 911.
  • the sensor 917 is an inertial measurement unit (IMU) sensor.
  • IMU inertial measurement unit
  • the sensor 917 recognizes user gestures and movement to interact with the data linked using a semantic model in the virtual 3D environment.
  • the sensor 917 recognizes user gestures to modify the linked data in the virtual 3D environment, or to display additional or different knowledge from linked repositories in the virtual 3D environment.
  • the user interface 909 also includes a rendering engine (e.g., via memory 913 and processor 915) for rendering the virtual 3D environment.
  • the rendering engine may be part of the server 905 or the workstation 919, and the rendered virtual 3D environment is sent to the user interface 909 via network 903.
  • the user interface 909 may be configured to receive the rendered virtual 3D environment for display based on a gesture input captured by the sensor 917.
  • the rendering engine is configured to receive data linked to a semantic model (e.g., information stored in database 907) and geometric data and metadata from a CAD file 921 from workstation 919. Rendering the virtual 3D environment, based on the linked data, is a virtual, augmented, or mixed reality video stream for display to the user via the display 911 of the user interface 909.
  • the server 905 and workstation 919 are computer platforms having hardware such as one or more central processing units (CPU), a system memory, a random access memory (RAM) and input/output (I/O) interface(s). Additional, different or fewer components may be provided.
  • the server 905 includes a repository 907 for storing the linked data (e.g., as a cloud server).
  • the workstation 919 includes a CAD file 921 of a CAD program running on the
  • the system 900 also includes one or more networks 903.
  • the network 903 is a wired or wireless network, or a combination thereof.
  • Network 903 is configured as a local area network (LAN), wide area network (WAN), intranet, Internet or other now known or later developed network configurations. Any network or combination of networks for communicating between the user interface 909, the server 905, the workstation 919 and other components may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

En guise d'introduction, selon les présents modes de réalisation décrits ci-dessous, l'invention comprend des appareils et des procédés permettant de lier des données CAD à d'autres modèles de connaissances et d'afficher les données liées dans un environnement 3D virtuel. Les données CAD sont extraites d'un fichier CAD sur la base du mappage du format de fichier CAD avec un modèle/une ontologie sémantique selon des technologies sémantiques existantes. Les données CAD extraites sont liées à des modèles de connaissances existants à l'aide de propriétés associées à l'ontologie, ce qui améliore les données CAD et permet d'afficher les relations entre les données CAD extraites et les connaissances existantes dans un environnement 3D virtuel. Une connaissance liée au fichier CAD est affichée, permettant à un utilisateur d'explorer des liens entre différentes sources de données par déplacement interactif à travers les données liées dans l'environnement 3D, par exemple au moyen d'une réalité virtuelle, augmentée ou mixte.
PCT/US2017/046890 2016-10-24 2017-08-15 Intégration de fichiers cad dans des modèles sémantiques et visualisation de données liées dans un environnement 3d WO2018080616A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662411796P 2016-10-24 2016-10-24
US62/411,796 2016-10-24

Publications (1)

Publication Number Publication Date
WO2018080616A1 true WO2018080616A1 (fr) 2018-05-03

Family

ID=59702874

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/046890 WO2018080616A1 (fr) 2016-10-24 2017-08-15 Intégration de fichiers cad dans des modèles sémantiques et visualisation de données liées dans un environnement 3d

Country Status (1)

Country Link
WO (1) WO2018080616A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109671156A (zh) * 2018-12-27 2019-04-23 成都四方伟业软件股份有限公司 三维模型加载方法和装置
WO2020055779A1 (fr) * 2018-09-10 2020-03-19 Aveva Software, Llc Système et procédé d'intégration de géométrie de tiers pour la visualisation de grands ensembles de données
WO2020182275A1 (fr) * 2019-03-08 2020-09-17 Abb Schweiz Ag Interfaçage avec un environnement virtuel
EP3910518A1 (fr) * 2020-05-13 2021-11-17 Siemens Aktiengesellschaft Augmentation d'une représentation schématique d'une infrastructure technique
EP3910517A1 (fr) * 2020-05-13 2021-11-17 Siemens Aktiengesellschaft Augmentation d'une structure tridimensionnelle d'une infrastructure technique

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2415520A (en) * 2004-06-25 2005-12-28 Myriad Vision Ltd Hierarchical 3D data system
EP1732020A2 (fr) * 2005-06-10 2006-12-13 Kabushiki Kaisha Toshiba Dispositif générant les données Cad et procédé de génération
US20100042658A1 (en) * 2008-08-13 2010-02-18 Ibm Corporation Method for cad knowledge management

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2415520A (en) * 2004-06-25 2005-12-28 Myriad Vision Ltd Hierarchical 3D data system
EP1732020A2 (fr) * 2005-06-10 2006-12-13 Kabushiki Kaisha Toshiba Dispositif générant les données Cad et procédé de génération
US20100042658A1 (en) * 2008-08-13 2010-02-18 Ibm Corporation Method for cad knowledge management

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020055779A1 (fr) * 2018-09-10 2020-03-19 Aveva Software, Llc Système et procédé d'intégration de géométrie de tiers pour la visualisation de grands ensembles de données
US11094101B2 (en) 2018-09-10 2021-08-17 Aveva Software, Llc Integration of 3rd party geometry for visualization of large data sets system and method
US11887239B2 (en) 2018-09-10 2024-01-30 Aveva Software, Llc Integration of 3rd party geometry for visualization of large data sets system and method
CN109671156A (zh) * 2018-12-27 2019-04-23 成都四方伟业软件股份有限公司 三维模型加载方法和装置
WO2020182275A1 (fr) * 2019-03-08 2020-09-17 Abb Schweiz Ag Interfaçage avec un environnement virtuel
EP3910518A1 (fr) * 2020-05-13 2021-11-17 Siemens Aktiengesellschaft Augmentation d'une représentation schématique d'une infrastructure technique
EP3910517A1 (fr) * 2020-05-13 2021-11-17 Siemens Aktiengesellschaft Augmentation d'une structure tridimensionnelle d'une infrastructure technique

Similar Documents

Publication Publication Date Title
WO2018080616A1 (fr) Intégration de fichiers cad dans des modèles sémantiques et visualisation de données liées dans un environnement 3d
Kalogerakis et al. Coupling ontologies with graphics content for knowledge driven visualization
EP2907050B1 (fr) Plateforme cloud de gestion données de conception
JP7128188B2 (ja) ３次元モデル構築方法、装置及びシステム
Wagner et al. Representing construction-related geometry in a semantic web context: A review of approaches
Xu et al. 3D visualization for building information models based upon IFC and WebGL integration
Flotyński et al. Conceptual knowledge-based modeling of interactive 3D content
KR102516231B1 (ko) 네트워크 기반 미디어 처리(nbmp)에서의 미디어 처리 함수를 대한 구성 파라미터의 그래프 표현 및 설명
KR101665861B1 (ko) ＩｏＴ 환경에서의 데이터 처리 시스템 및 방법
Jayasekera et al. Assembly validation in virtual reality—a demonstrative case
Roßner et al. Visualization of the relevance: Using physics simulations for encoding context
Walczak et al. Building contextual augmented reality environments with semantics
Walczak et al. Semantic query-based generation of customized 3D scenes
Bouillon et al. Flexible re-engineering of web sites
Flotyński Semantic modelling of interactive 3d content with domain-specific ontologies
KR20220031522A (ko) 디지털 트윈과 그래프 기반 구조를 가진 컴퓨터 구현 시스템 및 방법
Flotyński et al. Composing customized web 3D animations with semantic queries
Flotyński et al. Semantic 4-dimensional modeling of VR content in a heterogeneous collaborative environment
CN111191458B (zh) 一种基于上下文的语义匹配方法和系统
Walczak et al. Inference-based creation of synthetic 3D content with ontologies
de Leng et al. Towards on-demand semantic event processing for stream reasoning
KR20130013233A (ko) 관계형 데이터베이스의 ｏｗｌ 온톨로지 변환방법 및 그 장치
Flotyński Visual aspect-oriented modeling of explorable extended reality environments
Santos¹ et al. A systematic review of data exchange formats in advanced interaction environments
Jovanovic et al. Bridging user context and design models to build adaptive user interfaces

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17757998

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17757998

Country of ref document: EP

Kind code of ref document: A1