EP3088973B1 - Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems - Google Patents

Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems Download PDF

Info

Publication number
EP3088973B1
EP3088973B1 EP15166038.8A EP15166038A EP3088973B1 EP 3088973 B1 EP3088973 B1 EP 3088973B1 EP 15166038 A EP15166038 A EP 15166038A EP 3088973 B1 EP3088973 B1 EP 3088973B1
Authority
EP
European Patent Office
Prior art keywords
technical
component
parameter
representation
transportation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP15166038.8A
Other languages
English (en)
French (fr)
Other versions
EP3088973A1 (de
Inventor
Julien Kipp
Andreas Rüdenauer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
R3dt GmbH
Original Assignee
R3dt GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by R3dt GmbH filed Critical R3dt GmbH
Priority to EP15166038.8A priority Critical patent/EP3088973B1/de
Publication of EP3088973A1 publication Critical patent/EP3088973A1/de
Application granted granted Critical
Publication of EP3088973B1 publication Critical patent/EP3088973B1/de
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00—Testing or monitoring of control systems or parts thereof
    • G05B23/02—Electric testing or monitoring
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B17/00—Systems involving the use of models or simulators of said systems
    • G05B17/02—Systems involving the use of models or simulators of said systems electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/32—Operator till task planning
    • G05B2219/32351—Visual, graphical animation of process
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present invention generally relates to electronic data processing, and more particularly, relates to methods, computer program products and systems for control of technical systems.
  • a technical system within the meaning of this document is intended to include systems like multi-component machines (e.g., a hydraulic excavator) up to whole production systems (e.g., a chemical plant).
  • multi-component machines e.g., a hydraulic excavator
  • whole production systems e.g., a chemical plant.
  • technical components of a chemical plant such as pipes, pumps, valves, etc. are illustrated as graphical symbols in a schematic two-dimensional plan scheme of the plant.
  • Such a plant scheme includes all functional connections of the various components where the values of critical process parameters are typically shown next to the respective graphical symbols of the technical components.
  • the computer system for three-dimensional (3D) monitoring of the technical status of a technical system includes one or more interface components configures to enable communication with other systems or components.
  • Such systems or components may be external (e.g., sensor components in the monitored technical system, technical status simulators, etc.) but can also be an integral part of the computer system itself (e.g., I/O means enabling user interaction with the computer system and a user).
  • the computer system can receive a three-dimensional CAD model of the technical system.
  • the CAD model includes three dimensional CAD representations of one or more technical components of the technical system. At least one particular technical component has a, sectionwise rotation symmetry and performs a physical transportation function characterized by a physical transportation parameter.
  • the technical system may transport a liquid or gas medium through at least some of its components which can be characterized by a flow speed or flow velocity of the respective medium.
  • medium also includes electrons which are transported by a conducting layer resulting in an electric current.
  • the computer system further receives parameter values of the physical transportation parameter over time representing the chronological development of the technical status of the at least one particular technical component.
  • Further physical parameters such as temperature or pressure may characterize the technical status of the respective components and can also be received by the computer system in addition to the transportation parameter.
  • the parameters may be received over time from respective sensors of the technical system while being operated, or from a simulation system simulating the technical status of the technical system over time.
  • the computer system further has a model transformer component configured to transform the three-dimensional CAD representation of the at least one particular technical component into a corresponding three-dimensional polygonal representation.
  • a model transformer component configured to transform the three-dimensional CAD representation of the at least one particular technical component into a corresponding three-dimensional polygonal representation.
  • an appropriate tessellation method is used.
  • the three-dimensional polygonal representation is stored in a polygonal representation storage component.
  • Systems with sufficiently large main memory may store the polygonal representations directly in main memory.
  • the tessellation may be performed according to a predefined scaling factor reflecting the accuracy of the polygonal representation.
  • the computer system can allow to modify the scaling factor to adjust the accuracy of the polygonal representation resulting from using the predefined scaling factor.
  • the degree of accuracy affects the time it takes to generate the visual representation of the physical parameters.
  • the modification of the scaling factor can be repeated until a satisfying result is achieved with sufficient accuracy for the 3D visualization providing sufficient rendering performance for real time technical status monitoring.
  • a monitoring functions component of the computer system allows to associate a monitoring function with the polygonal representation of the at least one particular technical component.
  • the monitoring function is configured to monitor at least the physical transportation parameter characterizing the technical status of the at least one particular technical component. Further monitoring functions can be assigned to the same particular technical component if additional technical status parameters are to be monitored (see above examples).
  • a direction determination component of the computer system determines, for each vertex of the polygonal representation of the at least one particular technical component, a transportation direction by using the symmetric property.
  • the transportation direction indicates for each vertex of each polygon the spatial course (geometry) of the respective technical component in 3D space, and thereby determines the direction in which the transported medium moves.
  • the spatial course of the technical component may include straight portions and bended portions.
  • a visual parameter representation computation component of the computer system generates, for each vertex of the polygonal representation of the at least one particular technical component, an animated visual representation of the physical transportation parameter over time in accordance with the determined transportation directions and the received parameter values.
  • the generated representation of the physical transportation parameter over time is then provided to a visualization component where it is visualized for the user.
  • the visual representation may be based on a surface texture flowing in the transportation direction, or it can be based on a particle system with particles moving in the transportation direction.
  • the flowing surface texture can be generated by displacing a texture visualization parameter value for a vertex by the corresponding physical transportation parameter value in the transportation direction.
  • a computer program product which is loaded into a memory of the computer system and executed by at least one processor of the computer system causes the computer system to execute steps of a computer implemented method performing the above disclosed functions of the computer system.
  • FIG. 1 shows a simplified block diagram of a computer system 100 for solving the technical problem of automatically giving visual indications about the physical conditions of a technical system by three-dimensional monitoring of the technical status of the technical system according to an embodiment of the invention.
  • FIG. 1 will be explained in the context of its use for executing the computer-implemented method 1000 illustrated in FIG. 2 .
  • the computer system 100 has one or more interface components 110 to communicate with external components or systems.
  • the communicative coupling with external components or systems can be implemented by using any appropriate network connection, such as a local area network (LAN) including wireless networks or a wide area network (WAN) like the Internet.
  • LAN local area network
  • WAN wide area network
  • a person skilled in the art knows how to implement such connectivity by using appropriate communication protocols.
  • One interface or a corresponding interface portion of the computer system 100 is configured to receive 1100 three-dimensional Computer Aided Design (CAD) data from a CAD database 101.
  • the CAD database 101 stores a CAD model 10 of a technical system (illustrated by a three-dimensional cuboid coupled with a three-dimensional cylindrical object, such as a tube) which is received by the computer system 100.
  • CAD systems are: the CATIA system offered by Dassault Systdiags, Velizy-Villacoublay Cedex - France, or the AUTOCAD system offered by Autodesk, Inc., San Rafael, CA 94903 USA. Any other three-dimensional CAD system may be used with an appropriate interface.
  • the received three-dimensional CAD model 10 represents a technical system (e.g., a machine or a production line).
  • the CAD model 10 includes three dimensional CAD representations of one or more technical components of the technical system wherein at least one particular technical component has a symmetric property and performs a physical transportation function characterized by a physical transportation parameter.
  • the CAD model has a cuboid representation of a first component (e.g., pump, valve, etc.) and a tube shaped representation of a second component (e.g., pipe).
  • the symmetric property can be a sectionwise rotation symmetry as in the case of a pipe.
  • Sectionwise in this context means that the pipe does not need to be a cylindrical object in its entirety but sections of the pipe are of cylindrical shape so that the entire pipe can be approximated by cylindrical sections.
  • the symmetric property can be a symmetry with respect to a line.
  • a conductive path implemented by a doped layer in a semiconductor for transporting electrons (electric current) through the conductive path would rather show a symmetry with respect to a line than a rotation symmetry.
  • the CAD model includes further representations of further technical components.
  • the technical system is configured to transport a liquid or a gas.
  • the physical transportation function corresponds to the capability of the technical system/components to transport material (liquid, gas) through the technical system/components.
  • This physical transportation function is characterized by a corresponding transportation parameter.
  • the transportation parameter can be the transportation speed vector which characterizes the flow speed and the flow direction of the transported medium (e.g., fluid, gas, electrons, etc.) through the technical components.
  • the transportation parameter can be the transportation speed vector which characterizes the flow speed and the flow direction of the transported medium (e.g., fluid, gas, electrons, etc.) through the technical components.
  • the pressure or temperature of the transported medium can complement the physical transportation parameter to provide more details about the technical status of the various technical components.
  • the received CAD model data 10 is provided to a model transformer component (MTC) 120.
  • MTC 120 is configured to transform 1200 the three-dimensional CAD representation of at least one particular technical component into a corresponding three-dimensional polygonal representation.
  • MTC 120 is configured to transform 1200 the three-dimensional CAD representation of at least one particular technical component into a corresponding three-dimensional polygonal representation.
  • MTC 120 is configured to transform 1200 the three-dimensional CAD representation of at least one particular technical component into a corresponding three-dimensional polygonal representation.
  • Many tessellation methods such as for example Delaunay Triangulation and Recursive Subdivision, are known in the art.
  • a tessellation of a parametric surface (NURBS surfaces being the most commonly used) is the tiling of such a surface using one or more geometric shapes, often called tiles, with no overlaps and no gaps.
  • the tiles are polygons (e.g., triangles) and a predefined scaling factor can be used to determine an intended tessellation density.
  • the tessellation density reflects the accuracy of the polygonal representation with regards to the original flat surfaces of the received CAD model(s). In other words, the smaller the generated polygons are, the closer the transformed polygonal representation of a particular 3D component comes to the original flat surface of the respective CAD model component.
  • a check may be performed 1240 to verify if the resolution of the polygonal representation is sufficient for later visualization purposes.
  • the check 1240 may be performed by a user of the computer system 100 or automatically by an appropriate check tool. Such a check tool may compute surface changes as a measure for errors. If the resolution needs to be increased or decreased, the transforming step can be repeated 1250 with a modified scaling factor to adjust the accuracy of the polygonal representation which affects the time it takes to generate the visual representation of the physical parameters. The higher the resolution, the longer it takes to generate the visual representations. This can be a critical factor in real time 3D monitoring of the technical status of the various system components.
  • FIGs. 4A, 4B, and 4C show three polygonal representations as tessellation results of a bent pipe component at three different resolution levels.
  • FIG. 4A uses a lower scaling factor resulting in larger polygonal elements (e.g., triangles) than FIG. 4B (medium scaling factor) and FIG. 4C (higher scaling factor).
  • the MTC 120 has transformed a particular CAD model component into a respective polygonal 3D representation of the technical component with an appropriate scaling factor (e.g., the pre-defined scaling factor) the particular 3D polygonal representation can be stored in a polygonal representation storage component 130 (PRSC) for later use.
  • PRSC polygonal representation storage component 130
  • the computer system 100 further has a monitoring functions component 140 (MFC) which is configured to associate 1300 a monitoring function with the polygonal representation of the at least one particular technical component.
  • a monitoring function as used hereinafter, is configured to monitor at least the physical transportation parameter characterizing the technical status of the at least one particular technical component. More than one monitoring function can be associated with a particular polygonal representation of a technical component. For example, one monitoring function can be configured to monitor the flow speed of the medium transported through the technical component. Another monitoring function may be configured to monitor the temperature or pressure of the respective medium.
  • the MFC 140 can include a plurality of pre-defined monitoring functions for monitoring corresponding physical system parameters and provide the possibility that a user of the computer system 100 can select any one of such monitoring functions and assign it to a particular polygonal component representation.
  • a user of the computer system 100 can select any one of such monitoring functions and assign it to a particular polygonal component representation.
  • such an assignment can be implemented through a drag and drop, drag and relate, or similar user interaction patterns with the computer system (e.g., by using the I/O means 103) and results in the assigned monitoring function being associated with the respective technical component. Any other suitable user interaction method to establish the association between the particular polygonal component representation and the respective one or more monitoring functions may be used.
  • the computer system further has a direction determination component 150 (DDC) configured to determine 1400, for each polygon of the polygonal representation of the at least one particular technical component, a transportation direction by using the symmetric property of the respective technical component.
  • DDC direction determination component 150
  • the DDC 150 can automatically determine the flow direction of the transported medium for each polygon in the polygonal representation of the technical component. Details of the DDC 150 are disclosed in FIGs. 3 and 4A to 4D .
  • the one or more interfaces 110 further implement an interface to receive 1500 parameter values 20 of the physical transportation parameter over time from at least one source system 102.
  • the at least one source system is to be understood as the system(s) providing the parameter values to the one or more interfaces.
  • other technical status parameters e.g., temperature, pressure, etc.
  • the received parameter values 20 represent the chronological development of the technical status of the at least one particular technical component.
  • the received parameter values 20 over time are measurement values from respective sensors of the technical system while being operated.
  • sensors can measure in real time (at the sampling rate of the respective sensor) physical parameter values which characterize the physical status of the respective technical component(s).
  • the source system 102 of the technical parameter values corresponds to the technical system itself which is equipped with respective measurement devices/sensors.
  • the one or more interface components 110 implement a functional mockup interface or a VDMA 24583 interface (i.e., an interface which complies with the VDMA 24583 Revision Draft 2012, Title: Gusma - An Integrational Platform For Coupled, Cross-Company Simulation - Revision Draft 2012) configured to receive the parameter values 20 over time from a simulation system simulating the technical status of the technical system over time.
  • the simulation system as a source system 102 for the technical parameter values can provide technical status data for different situations. For example, the system may compute the parameter values under ideal conditions or under certain disturbances. This allows using the computer system 100 during the design phase of the technical system for optimization of the various technical components.
  • the monitoring of the simulated technical system in operation is a technical process on its supporting an improved design of the technical system which can then be operated with ideal parameter values for robust operation.
  • This embodiment can also be combined with the previously disclosed embodiment to compare the real world monitored technical status of a particular technical system component according to the monitored real time sensor data with a simulated technical status of this system component.
  • a deviation outside of a predefined tolerance range can be an indicator for a malfunctioning of the technical system component.
  • the computer system 100 further has a visual parameter representation computation component 160 (VPRC) configured to generate 1600, for the polygons of the polygonal representation of the at least one particular technical component, an animated visual representation 30 (illustrated by dotted surface) of the physical transportation parameter over time in accordance with the determined transportation directions and the received parameter values 20.
  • VPRC visual parameter representation computation component 160
  • the VPRC 160 can shift the visual representation 30 of the physical transportation parameter by the respective transportation velocity vector in each polygon at a frequency which corresponds to the flow speed of the transported medium.
  • the animated visual representation is using a surface texture flowing in the transportation direction determined by the DDC 150.
  • the animated visual representation is using a particle system with particles moving in the transportation direction.
  • the computation makes use of a sectionwise rotation symmetry of the technical components.
  • a corresponding algorithm is used for the computation of 3D texture coordinates for the 3D polygonal representations of respective CAD components made up of cylindrical sections.
  • a transportation behavior (flow behavior) of the transported medium e.g., fluids, gas, signal currents
  • the depiction of this flow behavior can be achieved through particles systems or through moving a 3D texture along the surface of the 3D polygonal representations using the calculated texture coordinates.
  • the individual sections of the 3D polygonal representations can be right cylinders 320 or skewed cylinders 310 as illustrated in FIG. 3 .
  • the 3D polygonal representation of a technical component with sectionwise rotation symmetry can then be composed of a plurality of right or skewed cylinder sections wherein each section has a given height.
  • FIGs. 4A to 4C illustrate by example the result of a transformation of the CAD model of a 90°bent pipe component into respective 3D polygonal representations using a tessellation method with different scaling factors.
  • the example uses triangles as polygons (other polygons may be used instead), wherein each triangle is defined by three vertices (illustrated for the triangles (V 1 , V 2 , V 3 ), (V 2 , V 3 , V 4 ), (V 3 , V 4 , V 5 ), (V 4 , V 5 , V 6 ) of FIG. 4A by black dots).
  • the DDC executes a course determination algorithm (CDA) which first identifies a start condition for the algorithm.
  • the start condition for a sectionwise rotation symmetric component is typically a vertex ring referred to as starting ring hereinafter.
  • a first assumption by the CDA is that the technical component, and as a consequence also the 3D polygonal representation of the technical component, has "open" ends instead of capped ends. I.e. there is no vertex in the polygonal representation which is not part of a vertex ring. For example, in FIG.
  • vertices V 2 , V 4 , V 6 are part of the vertex ring 410.
  • Vertices V 1 , V 3 , V 5 are part of the vertex ring 420.
  • the CDA can detect the starting ring by the number of triangles a vertex is part of. In the example of the polygons being triangles, vertices that are part of exactly three triangles belong to the starting ring 410.
  • V 4 belongs to the triangles (V 2 , V 3 , V 4 ), (V 3 , V 4 , V 5 ), (V 4 , V 5 , V 6 ) and is therefore part of the starting ring 410.
  • vertices V 2 , V 6 belong to three respective triangles are therefore part of the starting ring 410.
  • the below pseudo code sections 1.0/1.1 show by way of example how the CDA first counts the number of triangles for each vertex and gets those that have exactly three of them.
  • the starting ring 410 for the actual course detection can be determined (cf. pseud code 1.2).
  • the other end of the bent pipe could serve as a starting ring as well because the vertices also belong to three triangles and the CDA can work in both directions.
  • Every vertex ring 410, 420, 430, etc. of the 3D polygonal representation is traversed (starting from the precomputed set of vertices as the starting ring 410) and for every vertex (Vn) the distance to its successor (Vn+1) in the next vertex ring is computed.
  • the desired 3D texture coordinates represent a virtual position of every vertex in a 3D space where the CAD model (and the respective polygonal representation) has a straight course.
  • all vertices in a vertex ring have the same distance to the subsequent vertex ring.
  • all the cylindrical sections can be transformed from skewed to right cylinders (cf. FIG. 3 ). Therefore, the CDA can equalize the computed distances of all k vertices in a vertex ring. This can be done through various functions producing results of varying quality.
  • d 0 dist v 0 n , v 0 n + 1
  • a virtual position p'(vn+1) is computed by moving the virtual position of the preceding vertex p'(vn) in direction r by the one step earlier computed equalized distance d. From here it is apparent that the resulting coordinates describe a model of the technical component with a straight course, considering each vertex ring is displaced in the same direction r .
  • Pseudo code 3.1 summarizes the CDA steps which finally lead to the result that for each vertex of each polygon the course direction (corresponding to the transportation direction of the transported medium in the respective technical component) is determined.
  • the first example is based on texture visualization.
  • 3D objects can be visualized by projecting two dimensional textures onto the surface of the corresponding 3D visualization using two dimensional texture coordinates.
  • this involves the manual creation of 2D textures and respective coordinates and the optimization of the 2D textures and coordinates for specific 3D models.
  • textures that are defined in 3D space in conjunction with the automatic generation of suitable 3D texture coordinates, the visualization process can be automated.
  • the CDA described above provides virtual coordinates p' for every vertex in an arbitrary model matching the assumptions that the respective technical component has cylindrical sections with open ends where each vertex is part of a particular vertex ring. It also provides the direction r .
  • a function tex(u, v, w) that describes a texture in 3D space maps a position in 3D space onto a visualization parameter (e.g., a color value, a pattern type, etc.).
  • the computer system receives the physical transportation parameter values s (e.g., flow speed for the velocity of the transported medium) over time.
  • the displacement over time produces the desired flow behavior in the visualization.
  • the usage of the precomputed texture coordinates creates a flow along the bent object surface.
  • a snapshot of the generated transportation parameter visualization is shown in FIG. 4D .
  • black and white texture colors are shown.
  • the black and white areas correspond to many different color values which can represent different physical parameter values as technical status indicators for the respective technical component.
  • the second example for the alternative embodiments for generating the animated visual representation of the physical transportation parameter is based on particle visualization.
  • a particle system is a tool used in computer graphics to accomplish the visualization of smoke, fire, water or similar effects. It uses a high number of objects (particles) that move over time and can be displayed with several common methods (including a 2D texture). The movement of the particles can be either manually predefined, or computed through complex physics simulations.
  • the algorithm only needs to output the direction between each pair of vertex rings to lead the particles along the course of the model to create the desired flow behavior (e.g. moving electron representations along a cable to visualize electric current).
  • FIG. 5 and FIG. 5A illustrate a 3D polygonal representation of a hydraulic system 500 which includes a plurality of technical components, such as for example, pipes 510, 520, 525 and hydraulic piston cylinders 530, 540.
  • FIGs. 5 and 5A show the same system 500 where FIG. 5 is pure black and white and FIG. 5A includes a greyscale which improves the visibility of the previously described visualization effects. Further, FIG. 5A also shows the housing 590 of the piston cylinders in a transparent visualization (not visible in the black and white version of FIG. 5 ).
  • Pipe 510 has a different surface texture (generated according to the previously described embodiments of the invention) compared to the surface texture of pipe 520 or pipe 525. This indicates that the technical status of each pipe is different.
  • the movement of the surface textures visualizes the flow speed of the medium transported by the pipes.
  • the positional changes of the transported medium can be illustrated over time.
  • Each pipe texture may move according to a different flow speed.
  • Further physical parameter values may be visualized by the generated visualization structure.
  • the temperature values for the transported medium can be visualized by the color computed for the texture at the respective vertices.
  • the dark color of the pipes 520, 525 and the cylinder piston 540 may correspond to red indicating a temperature which is higher than the temperature in pipe 510 and piston cylinder 530 having a relatively bright color (e.g., light blue).
  • the monitoring system can, at any time, monitor technical status parameters reflecting the status of a technical system in a three-dimensional manner so that the exact physical location of any deviation from the desired technical status is immediately visible for an operator.
  • the system can visualize at least the technical status for two dimensions.
  • a first dimension thereby by is the transportation parameter (e.g., flow speed, velocity, electric current flow, etc.) of the transported medium which can be combined with at least a second dimension selected from complementary physical parameters (e.g., pressure, temperature, voltage, etc.).
  • the monitoring system allows to simultaneously monitor at least two critical operating parameters of the technical system with regards to the physical locations inside the technical system at any point in time.
  • FIG. 6 is a diagram that shows an example of a generic computer device 900 and a generic mobile computer device 950, which may be used with the techniques described here.
  • Computing device 900 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers.
  • Generic computer device may 900 correspond to the computer system 100 of FIG. 1 .
  • Computing device 950 is intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, and other similar computing devices.
  • computing device 950 may include the I/O means 103 as shown in FIG. 1 .
  • the components shown here, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed in this document.
  • Computing device 900 includes a processor 902, memory 904, a storage device 906, a high-speed interface 908 connecting to memory 904 and high-speed expansion ports 910, and a low speed interface 912 connecting to low speed bus 914 and storage device 906.
  • Each of the components 902, 904, 906, 908, 910, and 912 are interconnected using various busses, and may be mounted on a common motherboard or in other manners as appropriate.
  • the processor 902 can process instructions for execution within the computing device 900, including instructions stored in the memory 904 or on the storage device 906 to display graphical information for a GUI on an external input/output device, such as display 916 coupled to high speed interface 908.
  • multiple processors and/or multiple buses may be used, as appropriate, along with multiple memories and types of memory.
  • multiple computing devices 900 may be connected, with each device providing portions of the necessary operations (e.g., as a server bank, a group of blade servers, or a multi-processor system).
  • the memory 904 stores information within the computing device 900.
  • the memory 904 is a volatile memory unit or units.
  • the memory 904 is a non-volatile memory unit or units.
  • the memory 904 may also be another form of computer-readable medium, such as a magnetic or optical disk.
  • the storage device 906 is capable of providing mass storage for the computing device 900.
  • the storage device 906 may be or contain a computer-readable medium, such as a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations.
  • a computer program product can be tangibly embodied in an information carrier.
  • the computer program product may also contain instructions that, when executed, perform one or more methods, such as those described above.
  • the information carrier is a computer- or machine-readable medium, such as the memory 904, the storage device 906, or memory on processor 902.
  • the high speed controller 908 manages bandwidth-intensive operations for the computing device 900, while the low speed controller 912 manages lower bandwidth-intensive operations.
  • the high-speed controller 908 is coupled to memory 904, display 916 (e.g., through a graphics processor or accelerator), and to high-speed expansion ports 910, which may accept various expansion cards (not shown).
  • low-speed controller 912 is coupled to storage device 906 and low-speed expansion port 914.
  • the low-speed expansion port which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) may be coupled to one or more input/output devices, such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router, e.g., through a network adapter.
  • input/output devices such as a keyboard, a pointing device, a scanner, or a networking device such as a switch or router, e.g., through a network adapter.
  • the computing device 900 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a standard server 920, or multiple times in a group of such servers. It may also be implemented as part of a rack server system 924. In addition, it may be implemented in a personal computer such as a laptop computer 922. Alternatively, components from computing device 900 may be combined with other components in a mobile device (not shown), such as device 950. Each of such devices may contain one or more of computing device 900, 950, and an entire system may be made up of multiple computing devices 900, 950 communicating with each other.
  • Computing device 950 includes a processor 952, memory 964, an input/output device such as a display 954, a communication interface 966, and a transceiver 968, among other components.
  • the device 950 may also be provided with a storage device, such as a microdrive or other device, to provide additional storage.
  • a storage device such as a microdrive or other device, to provide additional storage.
  • Each of the components 950, 952, 964, 954, 966, and 968 are interconnected using various buses, and several of the components may be mounted on a common motherboard or in other manners as appropriate.
  • the processor 952 can execute instructions within the computing device 950, including instructions stored in the memory 964.
  • the processor may be implemented as a chipset of chips that include separate and multiple analog and digital processors.
  • the processor may provide, for example, for coordination of the other components of the device 950, such as control of user interfaces, applications run by device 950, and wireless communication by device 950.
  • Processor 952 may communicate with a user through control interface 958 and display interface 956 coupled to a display 954.
  • the display 954 may be, for example, a TFT LCD (Thin-Film-Transistor Liquid Crystal Display) or an OLED (Organic Light Emitting Diode) display, or other appropriate display technology.
  • the display interface 956 may comprise appropriate circuitry for driving the display 954 to present graphical and other information to a user.
  • the control interface 958 may receive commands from a user and convert them for submission to the processor 952.
  • an external interface 962 may be provide in communication with processor 952, so as to enable near area communication of device 950 with other devices.
  • External interface 962 may provide, for example, for wired communication in some implementations, or for wireless communication in other implementations, and multiple interfaces may also be used.
  • the memory 964 stores information within the computing device 950.
  • the memory 964 can be implemented as one or more of a computer-readable medium or media, a volatile memory unit or units, or a non-volatile memory unit or units.
  • Expansion memory 984 may also be provided and connected to device 950 through expansion interface 982, which may include, for example, a SIMM (Single In Line Memory Module) card interface.
  • SIMM Single In Line Memory Module
  • expansion memory 984 may provide extra storage space for device 950, or may also store applications or other information for device 950.
  • expansion memory 984 may include instructions to carry out or supplement the processes described above, and may include secure information also.
  • expansion memory 984 may act as a security module for device 950, and may be programmed with instructions that permit secure use of device 950.
  • secure applications may be provided via the SIMM cards, along with additional information, such as placing the identifying information on the SIMM card in a non-hackable manner.
  • the memory may include, for example, flash memory and/or NVRAM memory, as discussed below.
  • a computer program product is tangibly embodied in an information carrier.
  • the computer program product contains instructions that, when executed, perform one or more methods, such as those described above.
  • the information carrier is a computer- or machine-readable medium, such as the memory 964, expansion memory 984, or memory on processor 952, that may be received, for example, over transceiver 968 or external interface 962.
  • Device 950 may communicate wirelessly through communication interface 966, which may include digital signal processing circuitry where necessary. Communication interface 966 may provide for communications under various modes or protocols, such as GSM voice calls, SMS, EMS, or MMS messaging, CDMA, TDMA, PDC, WCDMA, CDMA2000, or GPRS, among others. Such communication may occur, for example, through radio-frequency transceiver 968. In addition, short-range communication may occur, such as using a Bluetooth, WiFi, or other such transceiver (not shown). In addition, GPS (Global Positioning System) receiver module 980 may provide additional navigation- and location-related wireless data to device 950, which may be used as appropriate by applications running on device 950.
  • GPS Global Positioning System
  • Device 950 may also communicate audibly using audio codec 960, which may receive spoken information from a user and convert it to usable digital information. Audio codec 960 may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of device 950. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on device 950.
  • Audio codec 960 may receive spoken information from a user and convert it to usable digital information. Audio codec 960 may likewise generate audible sound for a user, such as through a speaker, e.g., in a handset of device 950. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.) and may also include sound generated by applications operating on device 950.
  • the computing device 950 may be implemented in a number of different forms, as shown in the figure. For example, it may be implemented as a cellular telephone 980. It may also be implemented as part of a smart phone 982, personal digital assistant, or other similar mobile device.
  • implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof.
  • ASICs application specific integrated circuits
  • These various implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
  • the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer.
  • a display device e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
  • a keyboard and a pointing device e.g., a mouse or a trackball
  • Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
  • the systems and techniques described here can be implemented in a computing device that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components.
  • the components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN”), a wide area network (“WAN”), and the Internet.
  • LAN local area network
  • WAN wide area network
  • the Internet the global information network
  • the computing device can include clients and servers.
  • a client and server are generally remote from each other and typically interact through a communication network.
  • the relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Processing Or Creating Images (AREA)

Claims (13)

  1. Computersystem (100) zum dreidimensionalen Überwachen des technischen Zustands eines technischen Systems, umfassend:
    eine oder mehrere Schnittstellenkomponenten (110), konfiguriert zum:
    Empfangen eines dreidimensionalen CAD-Modells (10) des technischen Systems, wobei das CAD-Modell (10) dreidimensionale CAD-Darstellungen einer oder mehrerer technischer Komponenten des technischen Systems beinhaltet, wobei mindestens eine bestimmte technische Komponente Abschnitte mit zylindrischer Form aufweist, die konfiguriert ist zum Approximieren an die mindestens eine bestimmte technische Komponente, nachstehend als die symmetrische Eigenschaft bezeichnet, und die mindestens eine bestimmte technische Komponente eine physikalische Transportfunktion erfüllt,
    gekennzeichnet durch einen physikalischen Transportparameter;
    Empfangen von Parameterwerten (20) des physikalischen Transportparameters im Laufe der Zeit, auch als über die Zeit bezeichnet, die die chronologische Entwicklung des technischen Zustands der mindestens einen bestimmten technischen Komponente darstellen; und
    Bereitstellen einer visuellen Darstellung (30) des physikalischen Transportparameters über die Zeit an eine Visualisierungskomponente (103);
    eine Modellumformkomponente (120), die konfiguriert ist zum Umformen der dreidimensionalen CAD-Darstellung der mindestens einen bestimmten technischen Komponente in eine entsprechende dreidimensionale polygonale Darstellung unter Verwendung von Tesselierung;
    eine Überwachungsfunktionskomponente (140), die konfiguriert ist zum Zuordnen einer Überwachungsfunktion der polygonalen Darstellung der mindestens einen bestimmten technischen Komponente, wobei die Überwachungsfunktion konfiguriert ist zum Überwachen mindestens des physikalischen Transportparameters, der den technischen Zustand der mindestens einen bestimmten technischen Komponente kennzeichnet;
    eine Richtungsbestimmungskomponente (150), die konfiguriert ist zum Bestimmen einer Transportrichtung unter Verwendung der symmetrischen Eigenschaft für jeden Eckpunkt der polygonalen Darstellung der mindestens einen bestimmten technischen Komponente; und
    eine Berechnungskomponente (160) für die visuelle Parameterdarstellung, die konfiguriert ist zum Erzeugen einer animierten visuellen Darstellung (30) der physikalischen Transportparameter über die Zeit nach den festgelegten Transportrichtungen und den empfangenen Parameterwerten (20) für jeden Eckpunkt der polygonalen Darstellung der mindestens einen bestimmten technischen Komponente.
  2. Computersystem nach Anspruch 1, wobei die visuelle Darstellung eine Oberflächentextur verwendet, die in der Transportrichtung fließt, oder wobei die visuelle Darstellung ein Partikelsystem verwendet, dessen Partikel sich in der Transportrichtung bewegen.
  3. Computersystem nach einem der vorhergehenden Ansprüche, wobei die eine oder die mehreren Schnittstellenkomponenten (110) konfiguriert sind zum Empfangen der Parameterwerte von entsprechenden Sensoren des technischen Systems während des Betriebs im Laufe der Zeit.
  4. Computersystem nach einem der vorhergehenden Ansprüche, wobei die eine oder mehreren Schnittstellenkomponenten (110) eine funktionale Mockup-Schnittstelle oder eine VDMA 24583-Schnittstelle implementieren, die konfiguriert ist zum Empfangen der Parameterwerte von einem Simulationssystem im Laufe der Zeit, das den technischen Zustand des technischen Systems im Laufe der Zeit simuliert.
  5. Computerimplementiertes Verfahren (1000) zum dreidimensionalen Überwachen des technischen Zustands eines technischen Systems, umfassend:
    Empfangen (1100) eines dreidimensionalen CAD-Modells (10) des technischen Systems, wobei das CAD-Modell (10) dreidimensionale CAD-Darstellungen einer oder mehrerer technischer Komponenten des technischen Systems beinhaltet, wobei mindestens eine bestimmte technische Komponente Abschnitte mit zylindrischer Form aufweist, die konfiguriert sind, um sich der mindestens einen bestimmten technischen Komponente anzunähern, die nachfolgend als symmetrische Eigenschaft bezeichnet wird, und die mindestens eine bestimmte technische Komponente eine physikalische Transportfunktion ausführt, die durch einen physikalischen Transportparameter gekennzeichnet ist;
    Umformen (1200) mindestens der dreidimensionalen CAD-Darstellung der bestimmten technischen Komponente unter Verwendung von Tesselierung in eine entsprechende dreidimensionale polygonale Darstellung;
    Zuordnen (1300) einer Überwachungsfunktion zu der polygonalen Darstellung der bestimmten technischen Komponente, wobei die Überwachungsfunktion konfiguriert ist zum Überwachen mindestens des physikalischen Transportparameters, der den technischen Zustand der bestimmten technischen Komponente kennzeichnet;
    Bestimmen (1400) einer Transportrichtung für jeden Eckpunkt der polygonalen Darstellung der mindestens einen bestimmten technischen Komponente unter Verwendung der symmetrischen Eigenschaft;
    Empfangen (1500) von Parameterwerten (20) des physikalischen Transportparameters im Laufe der Zeit, die die chronologische Entwicklung des technischen Zustands der mindestens einen bestimmten technischen Komponente darstellen; und
    Erzeugen (1600) einer animierten visuellen Darstellung (30) des physikalischen Transportparameters im Laufe der Zeit, auch als über die Zeit bezeichnet, nach den festgelegten Transportrichtungen und den empfangenen Parameterwerten für jeden Eckpunkt der polygonalen Darstellung der mindestens einen bestimmten technischen Komponente.
  6. Verfahren nach Anspruch 5, wobei das Umformen (1200) nach einem Skalierungsfaktor durchgeführt wird, der die Genauigkeit der polygonalen Darstellung widerspiegelt, wobei das Verfahren ferner Folgendes umfasst:
    Wiederholen (1250) des Umformungsschritts mit einem modifizierten Skalierungsfaktor, um die Genauigkeit der polygonalen Darstellung anzupassen, die sich auf die Zeit auswirkt, die zum Erzeugen der visuellen Darstellung der physikalischen Parameter benötigt wird.
  7. Verfahren nach einem der Ansprüche 5 bis 6, wobei die visuelle Darstellung eine in Transportrichtung fließende Oberflächentextur verwendet.
  8. Verfahren nach Anspruch 7, wobei die fließende Oberflächentextur erzeugt wird, indem ein Texturvisualisierungsparameterwert für einen Eckpunkt um den entsprechenden physikalischen Transportparameterwert in Transportrichtung verschoben wird.
  9. Verfahren nach einem der Ansprüche 5 bis 6, wobei die visuelle Darstellung ein Partikelsystem mit Partikeln verwendet, die sich in Transportrichtung bewegen.
  10. Verfahren nach einem der Ansprüche 5 bis 9, wobei die Parameterwerte im Laufe der Zeit von jeweiligen Sensoren des technischen Systems während des Betriebs empfangen werden.
  11. Verfahren nach einem der Ansprüche 5 bis 10, wobei die Parameterwerte im Laufe der Zeit über eine funktionale Mockup-Schnittstelle oder über eine VDMA-Schnittstelle von einem Simulationssystem empfangen werden, das den technischen Zustand des technischen Systems im Laufe der Zeit simuliert.
  12. Verfahren nach einem der Ansprüche 5 bis 11, wobei ein weiterer technischer Zustandsparameter empfangen wird, wobei der weitere technische Zustandsparameter eine weitere Dimension des technischen Zustands der mindestens einen bestimmten technischen Komponente kennzeichnet und der weitere technische Zustandsparameter gleichzeitig mit der animierten visuellen Darstellung (30) in einer entsprechenden kombinierten visuellen Darstellung visualisiert wird.
  13. Computerprogrammprodukt mit Anweisungen, die beim Laden in einen Speicher einer Computervorrichtung und dem Ausführen von mindestens einem Prozessor der Computervorrichtung bewirken, dass die Computervorrichtung die Schritte des computerimplementierten Verfahrens nach einem der Ansprüche 5 bis 12 ausführt.
EP15166038.8A 2015-04-30 2015-04-30 Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems Not-in-force EP3088973B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP15166038.8A EP3088973B1 (de) 2015-04-30 2015-04-30 Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP15166038.8A EP3088973B1 (de) 2015-04-30 2015-04-30 Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems

Publications (2)

Publication Number Publication Date
EP3088973A1 EP3088973A1 (de) 2016-11-02
EP3088973B1 true EP3088973B1 (de) 2018-12-05

Family

ID=53052703

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15166038.8A Not-in-force EP3088973B1 (de) 2015-04-30 2015-04-30 Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems

Country Status (1)

Country Link
EP (1) EP3088973B1 (de)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107067340B (zh) * 2017-01-18 2024-02-13 上海核工程研究设计院股份有限公司 一种核电厂快速人因工程验证方法
JP7558636B2 (ja) 2018-12-05 2024-10-01 Juki株式会社 監視システム
CN114708791B (zh) * 2022-03-25 2023-12-22 中建科技集团北京低碳智慧城市科技有限公司 一种配电展示系统及方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2206041A4 (de) * 2007-10-01 2011-02-16 Iconics Inc Visualisierung von prozesssteuerungsdaten

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP3088973A1 (de) 2016-11-02

Similar Documents

Publication Publication Date Title
CN111741286B (zh) 使用光线投射法的基于图像的多个深度图像的几何融合
US9916684B2 (en) Generating portable three-dimensional print-preview renderings of three-dimensional models
US8254664B2 (en) System and method for measuring errors of workpieces
CN102947865B (zh) 用于光线跟踪中的图元相交的系统和方法
CN101496065B (zh) 采用像素掩模的图形系统
EP2426612B1 (de) Wasserzeichenmarkierung eines dreidimensionalen modellierten Objekts
US12367644B2 (en) Optimizing distance calculations for objects in three-dimensional views
TW201617944A (zh) 圖形化平面資料分析系統及方法
CN116018617A (zh) 用于生成基于喷溅的可微分二维渲染的系统和方法
EP3088973B1 (de) Computersystem und verfahren zur dreidimensionalen überwachung des technischen status eines technischen systems
US11640485B1 (en) Generating CAD models from topology optimization data
CN115375847A (zh) 材质恢复方法、三维模型的生成方法和模型的训练方法
CN115797565A (zh) 三维重建模型训练方法、三维重建方法、装置及电子设备
CN102831281B (zh) 在gocad软件中建立二维工作面的辅助建模方法
CN103339659A (zh) 用于在三维建模期间构建封闭体的系统和方法
CN118916942B (zh) 图像处理方法、装置、设备及可读介质
US20250078407A1 (en) Method for modifying a 3d model by using a partial sketch
US20240242437A1 (en) Computer-aided techniques for designing 3d surfaces based on gradient specifications
US12406327B2 (en) Systems, methods, and media for determining a stopping condition for model decimation
US20130212537A1 (en) Extracting Feature Information From Mesh
US20250245394A1 (en) Recovering a 2d wall center line from a 3d wall
CN120765862B (zh) 一种基于Unity的管路介质流速控制方法
CN107103642B (zh) 一种三维模型体素化实体填充方法
KR102958776B1 (ko) 상하수도 공사용 BIM(Building Information Modeling) 기반 설계 및 시공 관리 시스템 및 방법
CN114241300B (zh) 基于网格参数化的遥感影像目标识别训练样本生成方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170227

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180703

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: R3DT GMBH

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

RIN1 Information on inventor provided before grant (corrected)

Inventor name: RUEDENAUER, ANDREAS

Inventor name: KIPP, JULIEN

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1073832

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181215

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015020711

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20181205

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1073832

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181205

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190305

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190305

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190306

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190405

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190405

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015020711

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

26N No opposition filed

Effective date: 20190906

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181205

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20220425

Year of fee payment: 8

Ref country code: FR

Payment date: 20220420

Year of fee payment: 8

Ref country code: DE

Payment date: 20220419

Year of fee payment: 8

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602015020711

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230430

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230430

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231103