EP3168813A1 - A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects - Google Patents

A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects Download PDF

Info

Publication number
EP3168813A1
EP3168813A1 EP15306780.6A EP15306780A EP3168813A1 EP 3168813 A1 EP3168813 A1 EP 3168813A1 EP 15306780 A EP15306780 A EP 15306780A EP 3168813 A1 EP3168813 A1 EP 3168813A1
Authority
EP
European Patent Office
Prior art keywords
computer
assembly
revealable
objects
hiding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15306780.6A
Other languages
German (de)
French (fr)
Other versions
EP3168813B1 (en
Inventor
Nicolas Arques
Christophe Delfino
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dassault Systemes SE
Original Assignee
Dassault Systemes SE
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dassault Systemes SE filed Critical Dassault Systemes SE
Priority to EP15306780.6A priority Critical patent/EP3168813B1/en
Priority to US15/346,930 priority patent/US10162476B2/en
Priority to CN201611272138.2A priority patent/CN106991205B/en
Priority to JP2016219756A priority patent/JP6994825B2/en
Publication of EP3168813A1 publication Critical patent/EP3168813A1/en
Application granted granted Critical
Publication of EP3168813B1 publication Critical patent/EP3168813B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects
    • G06T15/503Blending, e.g. for anti-aliasing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/10Numerical modelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/20Configuration CAD, e.g. designing by assembling or positioning modules selected from libraries of predesigned modules
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04804Transparency, e.g. transparent or translucent windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/21Collision detection, intersection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/62Semi-transparency
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37Details of the operation on graphic patterns
    • G09G5/377Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns

Definitions

  • the invention relates to a method for displaying an assembly of digitally modeled objects wherein selected portions of at least one object, which would otherwise be hidden, are "revealed" by transparency through objects placed before them.
  • the invention also relates to a computer program product, a non-volatile computer-readable data-storage medium and a Computer Aided Design (CAD) system for carrying out such a method.
  • CAD Computer Aided Design
  • the invention applies to the field of computer graphics, and more particularly to the field of Computer Aided Design.
  • the invention is particularly suitable for producing technical illustrations, marketing presentations, assembly illustrations, training materials etc.
  • figure 1 shows a graphical representation of a toy car (on the left), and of its transmission (on the right).
  • the transmission In a "normal" representation of the car, the transmission is mostly hidden, as it lies behind the body and the front-left wheel of the car.
  • the transmission can be identified as taking priority over the body and the wheels, and therefore can be seen by transparency in the final, post-processed image (see figure 2 ).
  • the problem with this approach is that it is not possible to make the transmission visible only through specific regions of the body (or, conversely, to make visible only specific parts of the transmission).
  • the invention aims at overcoming these drawbacks of the prior art. More specifically the invention aims at providing a simple and effective method for revealing selected portions of "hidden" components of an assembly of three-dimensionally modeled objects. According to the invention, the method is carried out in 3D, thus allowing changing the point of view easily, and requires minimal human intervention.
  • this aim is achieved by introducing a graphical tool, called a "revealer", which allows selecting a specific region of the assembly wherein hidden components may be revealed by transparency through other objects located in front of them.
  • a graphical tool called a "revealer”
  • the revealer is a 3D object, which can be moved around, animated and adjusted in real time.
  • An object of the present invention is then a computer-implemented method of displaying an assembly of digitally modeled objects in a three-dimensional scene, the method comprising the steps of:
  • Another object of the invention is a computer program product, stored on a non-volatile computer-readable data-storage medium, comprising computer-executable instructions to cause a computer system to carry out such a method.
  • Another object of the invention is a non-volatile computer-readable data-storage medium containing computer-executable instructions to cause a computer system to carry out such a method.
  • Another object of the invention is a Computer Aided Design system comprising a processor coupled to a memory and a graphical user interface, the memory storing computer-executable instructions to cause the Computer Aided Design system to carry out such a method.
  • a "three-dimensional” (or “3D”) object will be an object - or a digital model thereof - allowing a three-dimensional (3D) representation.
  • a 3D representation allows the viewing of the part from all angles.
  • a 3D object when 3D represented, may be handled and turned around any of its axes, or around any axis in the screen on which the representation is displayed.
  • a "two-dimensional" (or "2D") object will be an object - or a digital model thereof - only allowing a two-dimensional (2D) representation e.g. on a plane.
  • a 2D object may only be translated in the plane of the screen on which the representation is displayed, or rotated around an axis perpendicular to said screen.
  • a "digital model" of an object is a data structure, or a set of data structures, which can be handled by a computer and contains all the information required by the computer to generate a 2D or 3D representation of the object.
  • the digital model may also contain other items of information, e.g. data representing physical parameters, but they are not required by the present invention.
  • figure 1 shows a graphical representation of a three-dimensional digitally-modeled assembly of objects A - in this case, a toy car - comprising at least two different objects which are rendered separately: a body HO and a transmission RO (represented separately).
  • the objects can be hierarchically organized in layers: the transmission belongs to an inner layer, the body to the outermost one. This means that, by virtue of the geometry of the assembly, the body "takes precedence” over the transmission and, when the two objects are superposed, only the body is visible. The body can then be called a "hiding object", as it "hides” other objects of the assembly which, when seen from a particular point of view, are located behind it.
  • a user may define the transmission RO as being "revealable", i.e. visible even when geometry dictates that it should be hidden. This may be done using a graphical interface, e.g. by locating a mouse pointer onto the representation of the transmission, performing a right click on it and selecting an option "Define as revealable” from a pop-up menu.
  • Figure 2 shows a graphical representation of the assembly A, obtained by combining the two separate representations of figure 1 . While rendering this representation, the computer takes account of both the "geometrical" and the "user-defined” priorities; as a consequence, the two objects HO, RO belonging to different layers are blended according to predefined (typically user-selectable) weights, called “transparency settings".
  • This mixing may be performed pixel by pixel; it typically involves defining, for each pixel of the final images, luminance and chrominance values given by linear combinations of the corresponding values for the images to be mixed. This does not affect the 3D digital models, but only the 2D image, obtained from said models, which is actually displayed on a computer display.
  • the following step of the inventive method consists in creating a "revealer", which allows selecting a region ("revealing zone") of the assembly wherein the hidden object defined as “revealable” will actually be revealed. This may be performed as illustrated on figures 3A - 3D .
  • a user launches the creation of the revealer, e.g. by positioning a pointer PT on a "revealer creation" button B of a suitable user interface.
  • the user selects - e.g. using the same pointer P - a point AP1 on the surface of the graphical representation of the assembly A.
  • the point AP1 corresponds to the center of the revealing zone to be defined by the revealer.
  • the user selects a second point AP2 determining the orientation of the revealer RC defining the revealing zone.
  • the revealing RC is a cone and AP2 is its apex, while AP1 corresponds to the intersection of the cone axis and the surface of the assembly A.
  • the point AP2 may be selected by clicking, or by drawing the pointer PT away from AP1 while keeping the left button of the mouse pressed and only releasing it when the pointer is located at the desired location of AP2.
  • the revealing zone RZ is defined by the intersection between the revealer and the surface of the assembly or, equivalently, by the projection of the outer surface of the revealer onto said surface.
  • the cone is created with a predetermined angular opening, say 30°, which can be adjusted by moving a third point AP3 which is located on the border of the revealing zone; this allows modifying the size of said zone ( figure 3D ).
  • the revealer RC is a 3D object whose parameters (position, orientation, angular opening) may be modified interactively using the three "anchor points" AP1, AP2, PA3. Moreover, if the assembly A is moved or rotated, the revealer follows it.
  • More than one revealer can be used, for instance two of them (RC1, RC2), defining respective revealing zones (RZ1, RZ2) are represented on figure 4 .
  • a computer graphic software is used for rendering a 3D scene representing the assembly, wherein the revealable object RO is revealed (e.g. using the technique discussed above with reference to figure 2 ) only within the revealing zone(s). This is illustrated on figure 4 .
  • the rendering is performed dynamically, i.e. in real time. It should be noted that some parts of the transmission RO (near the wheels) are visible even if they are outside the revealing zone - simply because they are not hidden by any other object having a higher "geometrical" priority.
  • the user may have the choice of hiding the revealers or leaving them apparent.
  • An advantageous feature of the invention is that, if the user moves or rotates the assembly within the scene (or, equivalently, changes the point of view from which the scene is seen), the revealing zones follow automatically these changes.
  • the inventive method can be performed by a suitably-programmed general-purpose computer or computer system, possibly including a computer network, storing a suitable program in non-volatile form on a computer-readable medium such as a hard disk, a solid state disk or a CD-ROM and executing said program using its microprocessor(s) and memory.
  • a suitably-programmed general-purpose computer or computer system possibly including a computer network, storing a suitable program in non-volatile form on a computer-readable medium such as a hard disk, a solid state disk or a CD-ROM and executing said program using its microprocessor(s) and memory.
  • a computer - more precisely a Computer Aided Design station - suitable for carrying out a method according to an exemplary embodiment of the present invention is described with reference to figure 5 .
  • the computer includes a Central Processing Unit (CPU) P which performs the processes described above.
  • the process can be stored as an executable program, i.e. a set of computer-readable instructions in memory, such as RAM M1 or ROM M2, or on hard disk drive (HDD) M3, DVD/CD drive M4, or can be stored remotely.
  • Three-dimensional digital models of objects forming an assembly are also stored on one or more of memory devices M1 to M4, or remotely.
  • the claimed invention is not limited by the form of the computer-readable media on which the computer-readable instructions and/or the digital models of the inventive process are stored.
  • the instructions and databases can be stored on CDs, DVDs, in FLASH memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk or any other information processing device with which the computer aided design station communicates, such as a server or computer.
  • the program and the models can be stored on a same memory device or on different memory devices.
  • a computer program suitable for carrying out the inventive method can be provided as a utility application, background daemon, or component of an operating system, or combination thereof, executing in conjunction with CPU 800 and an operating system such as Microsoft VISTA, Microsoft Windows 7, UNIX, Solaris, LINUX, Apple MAC-OS and other systems known to those skilled in the art.
  • an operating system such as Microsoft VISTA, Microsoft Windows 7, UNIX, Solaris, LINUX, Apple MAC-OS and other systems known to those skilled in the art.
  • CPU P can be a Xenon processor from Intel of America or an Opteron processor from AMD of America, or can be other processor types, such as a Freescale ColdFire, IMX, or ARM processor from Freescale Corporation of America.
  • the CPU can be a processor such as a Core2 Duo from Intel Corporation of America, or can be implemented on an FPGA, ASIC, PLD or using discrete logic circuits, as one of ordinary skill in the art would recognize.
  • the CPU can be implemented as multiple processors cooperatively working to perform the computer-readable instructions of the inventive processes described above.
  • the computer aided design station in figure 5 also includes a network interface NI, such as an Intel Ethernet PRO network interface card from Intel Corporation of America, for interfacing with a network, such as a local area network (LAN), wide area network (WAN), the Internet and the like.
  • the computer aided design station further includes a display controller DC, such as a NVIDIA GeForce GTX graphics adaptor from NVIDIA Corporation of America for interfacing with display DY, such as a Hewlett Packard HPL2445w LCD monitor.
  • a general purpose I/O interface IF interfaces with a keyboard KB and pointing device PD, such as a roller ball, mouse, touchpad and the like.
  • Disk controller DKC connects HDD M3 and DVD/CD M4 with communication bus CBS, which can be an ISA, EISA, VESA, PCI, or similar, for interconnecting all of the components of the computer aided design station.
  • CBS can be an ISA, EISA, VESA, PCI, or similar, for interconnecting all of the components of the computer aided design station.
  • Figure 6 is a block diagram of a computer system suitable for carrying out a method according to a different exemplary embodiment of the present invention.
  • the executable program EXP and the three-dimensional digital models of the objects are stored on memory devices connected to a server SC.
  • the memory devices and the overall architecture of the server may be the same as discussed above with reference to figure 5 , except that display controller, display, keyboard and/or pointing device may be missing in the server.
  • the server SC is then connected to an administrator system ADS and end user computer EUC via a network NW.
  • the overall architectures of the administrator system and of the end user computer may be the same as discussed above with reference to figure 5 , except that the memory devices of the administrator system and the end user computer do not store the executable program EXP and/or the three-dimensional digital models. However, the end user computer does store a client program designed for cooperating with the executable program of the server, as it will be discussed below.
  • the network NW can be a public network, such as the Internet, or a private network such as an LAN or WAN network, or any combination thereof and can also include PSTN or ISDN sub-networks.
  • the network NW can also be wired, such as an Ethernet network, or can be wireless such as a cellular network including EDGE, 3G and 4G wireless cellular systems.
  • the wireless network can also be Wi-Fi, Bluetooth, or any other wireless form of communication that is known.
  • the network NW is merely exemplary and in no way limits the scope of the present advancements.
  • the client program stored in a memory device of the end user computer and executed by a CPU of the latter accesses, via the network NW, a database MDB stored by the server SC and containing the three-dimensional digital models.
  • a database MDB stored by the server SC and containing the three-dimensional digital models.
  • This allows an end user to create an assembly of object and to define one or more of them as being revealable. It also allows the end user to parameterize a graphical representation of the assembly (e.g. by setting a point of view) and to create one or more revealers as described above.
  • the server performs the processing as described above, and transmits to the end user computer an image file corresponding to the desired representation of the assembly, again using the network NW.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)

Abstract

A computer-implemented method of displaying an assembly of digitally modeled objects in a three-dimensional scene, the method comprising the steps of: defining at least one object of the assembly as being revealable; generating a graphical representation of the assembly wherein said revealable object is located at least partially behind at least another object, called hiding object, and displaying said graphical representation; using a graphical tool for selecting a region of said graphical representation of the assembly, called a revealing zone; and rendering a three-dimensional scene comprising a three-dimensional representation of the assembly wherein a portion of the revealable object located behind the hiding object and comprised within the revealing zone is shown by transparency through said hiding object.
A computer program product, a non-volatile computer-readable data-storage medium and a Computer Aided Design system for carrying out such a method.

Description

  • The invention relates to a method for displaying an assembly of digitally modeled objects wherein selected portions of at least one object, which would otherwise be hidden, are "revealed" by transparency through objects placed before them. The invention also relates to a computer program product, a non-volatile computer-readable data-storage medium and a Computer Aided Design (CAD) system for carrying out such a method.
  • The invention applies to the field of computer graphics, and more particularly to the field of Computer Aided Design. The invention is particularly suitable for producing technical illustrations, marketing presentations, assembly illustrations, training materials etc.
  • In all the applications above, there is a need of representing assemblies of digitally-modeled objects which shows component which are normally hidden inside the assembly. For instance, it may be necessary to provide a representation of a car wherein the engine or other mechanical organs are visible ("revealed") through the body of the car.
  • In order to obtain this kind of graphical representation, it is known to use three-dimensional (3D) digital models of the assembly and of the hidden parts to be revealed, typically created using CAD software, to generate two-dimensional (2D) images thereof, and then to overlay these images in a 2D computer graphics software, using one or more masks to select the regions of interest, wherein the "hidden" part are revealed. This method is cumbersome and requires significant manual intervention from a user. Moreover, if the point of view from which the assembly is seen is changed, it is necessary to repeat the whole process.
  • An alternative approach operates directly in 3D, by prioritizing internal objects so that they are visible even when they are located behind other objects. For instance, figure 1 shows a graphical representation of a toy car (on the left), and of its transmission (on the right). In a "normal" representation of the car, the transmission is mostly hidden, as it lies behind the body and the front-left wheel of the car. However, the transmission can be identified as taking priority over the body and the wheels, and therefore can be seen by transparency in the final, post-processed image (see figure 2). The problem with this approach is that it is not possible to make the transmission visible only through specific regions of the body (or, conversely, to make visible only specific parts of the transmission).
  • The invention aims at overcoming these drawbacks of the prior art. More specifically the invention aims at providing a simple and effective method for revealing selected portions of "hidden" components of an assembly of three-dimensionally modeled objects. According to the invention, the method is carried out in 3D, thus allowing changing the point of view easily, and requires minimal human intervention.
  • According to the invention, this aim is achieved by introducing a graphical tool, called a "revealer", which allows selecting a specific region of the assembly wherein hidden components may be revealed by transparency through other objects located in front of them. An advantageous feature of the invention is that the revealer is a 3D object, which can be moved around, animated and adjusted in real time.
  • An object of the present invention is then a computer-implemented method of displaying an assembly of digitally modeled objects in a three-dimensional scene, the method comprising the steps of:
    1. a) defining at least one object of the assembly as being revealable;
    2. b) generating, from three-dimensional digital models of the objects, a graphical representation of the assembly as seen from a point of view, wherein said revealable object is located at least partially behind at least another object, called hiding object; and displaying said graphical representation;
    3. c) using a graphical tool for selecting a region of said graphical representation of the assembly, called a revealing zone; and
    4. d) rendering a three-dimensional scene comprising a three-dimensional representation of the assembly as seen from said point of view, wherein a portion of the revealable object located behind the hiding object and comprised within the revealing zone is shown by transparency through said hiding object, while portions of the revealable object located behind the hiding object are not visible.
  • According to particular embodiments of the invention:
    • Said step c) may be carried out by using a graphical user interface for creating a graphical tool defined at least by a position, an orientation and an angular opening, the revealing zone being defined by projection of a surface of the graphical tool onto a surface of the hiding object.
    • More particularly, said graphical tool may be a cone, called revealing cone, intersecting the three-dimensional digital model, the revealing zone being defined by the intersection between the surface of the hiding object and the revealing cone.
    • Said step b) may comprise generating a said graphical representation of said assembly, and all portions of the revealable object which are located behind the hiding object may then be shown by transparency through said hiding object.
    • Said step d) may comprise mixing pixels of said revealable object with corresponding pixels of said hiding object.
    • The objects of the assembly may be arranged in layers and objects belonging to layers other than an outermost one may be at least partially hidden by objects belonging to outer layers.
  • Another object of the invention is a computer program product, stored on a non-volatile computer-readable data-storage medium, comprising computer-executable instructions to cause a computer system to carry out such a method.
  • Another object of the invention is a non-volatile computer-readable data-storage medium containing computer-executable instructions to cause a computer system to carry out such a method.
  • Another object of the invention is a Computer Aided Design system comprising a processor coupled to a memory and a graphical user interface, the memory storing computer-executable instructions to cause the Computer Aided Design system to carry out such a method.
  • Additional features and advantages of the present invention will become apparent from the subsequent description, taken in conjunction with the accompanying drawings, which show:
    • Figure 1, a step of defining a revealable object of an assembly according to both an embodiment of the invention and the prior art;
    • Figure 2, a step of showing a graphical representation of an assembly of objects wherein both an hiding and a revealable object are visible, according to both an embodiment of the invention and the prior art;
    • Figures 3A - 3D, a step of creating a graphical tool for selecting a revealing zone according to an embodiment of the invention;
    • Figure 4, a graphical representation of the assembly of figure 2 obtained by a method according to an embodiment of the invention, wherein the revealable object is revealed by transparency through the hiding object within two revealing zones defined by respective graphical tools;
    • Figures 5 and 6, block diagrams of respective computer systems suitable for carrying out a method according to an embodiment of the invention.
  • Hereafter, a "three-dimensional" (or "3D") object will be an object - or a digital model thereof - allowing a three-dimensional (3D) representation. A 3D representation allows the viewing of the part from all angles. For example, a 3D object, when 3D represented, may be handled and turned around any of its axes, or around any axis in the screen on which the representation is displayed.
  • Conversely, a "two-dimensional" (or "2D") object will be an object - or a digital model thereof - only allowing a two-dimensional (2D) representation e.g. on a plane. For example, a 2D object may only be translated in the plane of the screen on which the representation is displayed, or rotated around an axis perpendicular to said screen.
  • A "digital model" of an object is a data structure, or a set of data structures, which can be handled by a computer and contains all the information required by the computer to generate a 2D or 3D representation of the object. The digital model may also contain other items of information, e.g. data representing physical parameters, but they are not required by the present invention.
  • As discussed above, figure 1 shows a graphical representation of a three-dimensional digitally-modeled assembly of objects A - in this case, a toy car - comprising at least two different objects which are rendered separately: a body HO and a transmission RO (represented separately). The objects can be hierarchically organized in layers: the transmission belongs to an inner layer, the body to the outermost one. This means that, by virtue of the geometry of the assembly, the body "takes precedence" over the transmission and, when the two objects are superposed, only the body is visible. The body can then be called a "hiding object", as it "hides" other objects of the assembly which, when seen from a particular point of view, are located behind it. A user, however, may define the transmission RO as being "revealable", i.e. visible even when geometry dictates that it should be hidden. This may be done using a graphical interface, e.g. by locating a mouse pointer onto the representation of the transmission, performing a right click on it and selecting an option "Define as revealable" from a pop-up menu.
  • Figure 2 shows a graphical representation of the assembly A, obtained by combining the two separate representations of figure 1. While rendering this representation, the computer takes account of both the "geometrical" and the "user-defined" priorities; as a consequence, the two objects HO, RO belonging to different layers are blended according to predefined (typically user-selectable) weights, called "transparency settings". This mixing may be performed pixel by pixel; it typically involves defining, for each pixel of the final images, luminance and chrominance values given by linear combinations of the corresponding values for the images to be mixed. This does not affect the 3D digital models, but only the 2D image, obtained from said models, which is actually displayed on a computer display.
  • The result is that the "hidden" object RO is revealed, i.e. is seen as by transparency through the hiding one, HO.
  • This corresponds to the prior art and, as explained above, is not wholly satisfactory. But, within the framework of the present invention, it only constitutes a preliminary step.
  • The following step of the inventive method consists in creating a "revealer", which allows selecting a region ("revealing zone") of the assembly wherein the hidden object defined as "revealable" will actually be revealed. This may be performed as illustrated on figures 3A - 3D.
  • First of all (figure 3A) a user launches the creation of the revealer, e.g. by positioning a pointer PT on a "revealer creation" button B of a suitable user interface.
  • Then (figure 3B) the user selects - e.g. using the same pointer P - a point AP1 on the surface of the graphical representation of the assembly A. Advantageously, the point AP1 corresponds to the center of the revealing zone to be defined by the revealer.
  • Subsequently (figure 3C) the user selects a second point AP2 determining the orientation of the revealer RC defining the revealing zone. In the exemplary embodiment of the figures, the revealing RC is a cone and AP2 is its apex, while AP1 corresponds to the intersection of the cone axis and the surface of the assembly A. The point AP2 may be selected by clicking, or by drawing the pointer PT away from AP1 while keeping the left button of the mouse pressed and only releasing it when the pointer is located at the desired location of AP2.
  • The revealing zone RZ is defined by the intersection between the revealer and the surface of the assembly or, equivalently, by the projection of the outer surface of the revealer onto said surface.
  • The cone is created with a predetermined angular opening, say 30°, which can be adjusted by moving a third point AP3 which is located on the border of the revealing zone; this allows modifying the size of said zone (figure 3D).
  • The revealer RC is a 3D object whose parameters (position, orientation, angular opening) may be modified interactively using the three "anchor points" AP1, AP2, PA3. Moreover, if the assembly A is moved or rotated, the reveler follows it.
  • More than one revealer can be used, for instance two of them (RC1, RC2), defining respective revealing zones (RZ1, RZ2) are represented on figure 4.
  • After that one or more revealer have been created, a computer graphic software is used for rendering a 3D scene representing the assembly, wherein the revealable object RO is revealed (e.g. using the technique discussed above with reference to figure 2) only within the revealing zone(s). This is illustrated on figure 4. The rendering is performed dynamically, i.e. in real time. It should be noted that some parts of the transmission RO (near the wheels) are visible even if they are outside the revealing zone - simply because they are not hidden by any other object having a higher "geometrical" priority.
  • The user may have the choice of hiding the revealers or leaving them apparent.
  • An advantageous feature of the invention is that, if the user moves or rotates the assembly within the scene (or, equivalently, changes the point of view from which the scene is seen), the revealing zones follow automatically these changes.
  • The inventive method has been described with reference to a particular embodiment, but several alternatives are possible. For instance:
    • In the embodiment described above, the revealable object RO is initially revealed everywhere and, after the creation of the revealers, the portions outside the revealing zones are hidden. It is also possible to start from a "regular" view of the assembly, showing no transparencies.
    • The revealers need not be revolution cones (i.e. cones having a circular basis perpendicular to its axis). More generally, they may be cones with a non-circular basis (or, in mathematical terms, directrix); in this case, the number of parameters - and therefore of anchor points - necessarily to define them may be greater than three (e.g. AP3 may be replaced by several anchor points, one for each vertex of a polygonal directrix). Even more generally, a revealer may not be conical at all but have e.g. the shape of a paraboloid.
    • A conical revealer may only be defined by two parameters instead of three - its height or its angular opening may be fixed. However, this is not preferred.
    • There are different ways to create a revealer, e.g. by manually entering numerical values for its parameter. However, the graphical approach illustrated by figures 3A - 3D is believed to be the most user-friendly.
  • The inventive method can be performed by a suitably-programmed general-purpose computer or computer system, possibly including a computer network, storing a suitable program in non-volatile form on a computer-readable medium such as a hard disk, a solid state disk or a CD-ROM and executing said program using its microprocessor(s) and memory.
  • A computer - more precisely a Computer Aided Design station - suitable for carrying out a method according to an exemplary embodiment of the present invention is described with reference to figure 5. In figure 5, the computer includes a Central Processing Unit (CPU) P which performs the processes described above. The process can be stored as an executable program, i.e. a set of computer-readable instructions in memory, such as RAM M1 or ROM M2, or on hard disk drive (HDD) M3, DVD/CD drive M4, or can be stored remotely. Three-dimensional digital models of objects forming an assembly are also stored on one or more of memory devices M1 to M4, or remotely.
  • The claimed invention is not limited by the form of the computer-readable media on which the computer-readable instructions and/or the digital models of the inventive process are stored. For example, the instructions and databases can be stored on CDs, DVDs, in FLASH memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk or any other information processing device with which the computer aided design station communicates, such as a server or computer. The program and the models can be stored on a same memory device or on different memory devices.
  • Further, a computer program suitable for carrying out the inventive method can be provided as a utility application, background daemon, or component of an operating system, or combination thereof, executing in conjunction with CPU 800 and an operating system such as Microsoft VISTA, Microsoft Windows 7, UNIX, Solaris, LINUX, Apple MAC-OS and other systems known to those skilled in the art.
  • CPU P can be a Xenon processor from Intel of America or an Opteron processor from AMD of America, or can be other processor types, such as a Freescale ColdFire, IMX, or ARM processor from Freescale Corporation of America. Alternatively, the CPU can be a processor such as a Core2 Duo from Intel Corporation of America, or can be implemented on an FPGA, ASIC, PLD or using discrete logic circuits, as one of ordinary skill in the art would recognize. Further, the CPU can be implemented as multiple processors cooperatively working to perform the computer-readable instructions of the inventive processes described above.
  • The computer aided design station in figure 5 also includes a network interface NI, such as an Intel Ethernet PRO network interface card from Intel Corporation of America, for interfacing with a network, such as a local area network (LAN), wide area network (WAN), the Internet and the like. The computer aided design station further includes a display controller DC, such as a NVIDIA GeForce GTX graphics adaptor from NVIDIA Corporation of America for interfacing with display DY, such as a Hewlett Packard HPL2445w LCD monitor. A general purpose I/O interface IF interfaces with a keyboard KB and pointing device PD, such as a roller ball, mouse, touchpad and the like. The display, the keyboard and the pointing device, together with the display controller and the I/O interfaces, form a graphical user interface.
  • Disk controller DKC connects HDD M3 and DVD/CD M4 with communication bus CBS, which can be an ISA, EISA, VESA, PCI, or similar, for interconnecting all of the components of the computer aided design station.
  • A description of the general features and functionality of the display, keyboard, pointing device, as well as the display controller, disk controller, network interface and I/O interface is omitted herein for brevity as these features are known.
  • Figure 6 is a block diagram of a computer system suitable for carrying out a method according to a different exemplary embodiment of the present invention.
  • In figure 6, the executable program EXP and the three-dimensional digital models of the objects are stored on memory devices connected to a server SC. The memory devices and the overall architecture of the server may be the same as discussed above with reference to figure 5, except that display controller, display, keyboard and/or pointing device may be missing in the server.
  • The server SC is then connected to an administrator system ADS and end user computer EUC via a network NW.
  • The overall architectures of the administrator system and of the end user computer may be the same as discussed above with reference to figure 5, except that the memory devices of the administrator system and the end user computer do not store the executable program EXP and/or the three-dimensional digital models. However, the end user computer does store a client program designed for cooperating with the executable program of the server, as it will be discussed below.
  • As can be appreciated, the network NW can be a public network, such as the Internet, or a private network such as an LAN or WAN network, or any combination thereof and can also include PSTN or ISDN sub-networks. The network NW can also be wired, such as an Ethernet network, or can be wireless such as a cellular network including EDGE, 3G and 4G wireless cellular systems. The wireless network can also be Wi-Fi, Bluetooth, or any other wireless form of communication that is known. Thus, the network NW is merely exemplary and in no way limits the scope of the present advancements.
  • The client program stored in a memory device of the end user computer and executed by a CPU of the latter accesses, via the network NW, a database MDB stored by the server SC and containing the three-dimensional digital models. This allows an end user to create an assembly of object and to define one or more of them as being revealable. It also allows the end user to parameterize a graphical representation of the assembly (e.g. by setting a point of view) and to create one or more revealers as described above. The server performs the processing as described above, and transmits to the end user computer an image file corresponding to the desired representation of the assembly, again using the network NW.
  • Although only one administrator system ADS and one end user system EUX are shown, the system can support any number of administrator systems and/or end user systems without limitation. Similarly, multiple servers, model database can also be implemented in the system without departing from the scope of the present invention
  • Any processes described herein should be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process, and alternate implementations are included within the scope of the exemplary embodiment of the present invention.

Claims (9)

  1. A computer-implemented method of displaying an assembly (A) of digitally modeled objects (RO, HO) in a three-dimensional scene, the method comprising the steps of:
    a) defining at least one object (RO) of the assembly as being revealable;
    b) generating, from three-dimensional digital models of the objects, a graphical representation of the assembly as seen from a point of view, wherein said revealable object (RO) is located at least partially behind at least another object (HO), called hiding object; and displaying said graphical representation;
    c) using a graphical tool (RC, RC1, RC2) for selecting a region of said graphical representation of the assembly, called a revealing zone (RZ, RZ1, RZ2); and
    d) rendering a three-dimensional scene comprising a three-dimensional representation of the assembly as seen from said point of view, wherein a portion of the revealable object located behind the hiding object and comprised within the revealing zone is shown by transparency through said hiding object, while portions of the revealable object located behind the hiding object are not visible.
  2. A method according to claim 1 wherein said step c) is carried out by using a graphical user interface (B, PT) for creating a graphical tool (RC) defined at least by a position, an orientation and an angular opening, the revealing zone being defined by projection of a surface of the graphical tool onto a surface of the hiding object.
  3. A method according to claim 2 wherein said graphical tool is a cone, called revealing cone, intersecting the three-dimensional digital model, the revealing zone being defined by the intersection between the surface of the hiding object and the revealing cone.
  4. A method according to any of the preceding claims wherein said step b) comprises generating a said graphical representation of said assembly, wherein all portions of the revealable object which are located behind the hiding object are shown by transparency through said hiding object.
  5. A method according to any of the preceding claims wherein said step d) comprises mixing pixels of said revealable object with corresponding pixels of said hiding object.
  6. A method according to any of the preceding claims wherein the objects of the assembly are arranged in layers and wherein objects belonging to layers other than an outermost one are at least partially hidden by objects belonging to outer layers.
  7. A computer program product, stored on a non-volatile computer-readable data-storage medium (M1 - M4), comprising computer-executable instructions to cause a computer system to carry out a method according to any of the preceding claims.
  8. A non-volatile computer-readable data-storage medium (M1 - M4) containing computer-executable instructions (EXP) to cause a computer system to carry out a method according to any of claims 1 to 6.
  9. A Computer Aided Design system comprising a processor (P) coupled to a memory (M1 - M4) and a graphical user interface (KB, PD, DC, DY), the memory storing computer-executable instructions (EXP) to cause the Computer Aided Design system to carry out a method according to any of claims 1 to 6.
EP15306780.6A 2015-11-10 2015-11-10 A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects Active EP3168813B1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP15306780.6A EP3168813B1 (en) 2015-11-10 2015-11-10 A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects
US15/346,930 US10162476B2 (en) 2015-11-10 2016-11-09 Computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects
CN201611272138.2A CN106991205B (en) 2015-11-10 2016-11-10 Method for displaying components of a digitally modeled object
JP2016219756A JP6994825B2 (en) 2015-11-10 2016-11-10 Computer implementation method to display an assembly of digitally modeled objects that reveals hidden objects

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP15306780.6A EP3168813B1 (en) 2015-11-10 2015-11-10 A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects

Publications (2)

Publication Number Publication Date
EP3168813A1 true EP3168813A1 (en) 2017-05-17
EP3168813B1 EP3168813B1 (en) 2020-06-17

Family

ID=54548120

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15306780.6A Active EP3168813B1 (en) 2015-11-10 2015-11-10 A computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects

Country Status (4)

Country Link
US (1) US10162476B2 (en)
EP (1) EP3168813B1 (en)
JP (1) JP6994825B2 (en)
CN (1) CN106991205B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3460763A1 (en) 2017-09-20 2019-03-27 Dassault Systèmes A computer-implemented method of displaying a subset of a digitally modeled assembly of objects

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3471061B1 (en) * 2017-10-13 2022-04-06 Dassault Systèmes Method for creating an animation summarizing a design process of a three-dimensional object
DE112018006721T5 (en) * 2017-12-29 2020-10-15 Mitutoyo Corporation INSPECTION PROGRAM EDITING ENVIRONMENT WITH AUTOMATIC VISIBILITY OPERATIONS FOR HIDDEN WORKPIECE CHARACTERISTICS
CN108282469B (en) * 2018-01-04 2020-09-04 暨南大学 Steganography method supporting attribute information extraction
US11367249B2 (en) * 2019-10-09 2022-06-21 Sap Se Tool for viewing 3D objects in 3D models

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1580674A2 (en) * 2004-03-22 2005-09-28 Solidworks Corporation Selection of obscured computer-generated objects

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102722338A (en) * 2012-06-15 2012-10-10 杭州电子科技大学 Touch screen based three-dimensional human model displaying and interacting method
US9858245B2 (en) * 2013-01-28 2018-01-02 The Boeing Company Panoptic visualization of elements of a complex system using a model viewer
US9460561B1 (en) * 2013-03-15 2016-10-04 Bentley Systems, Incorporated Hypermodel-based panorama augmentation
US9841870B2 (en) * 2014-08-21 2017-12-12 The Boeing Company Integrated visualization and analysis of a complex system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1580674A2 (en) * 2004-03-22 2005-09-28 Solidworks Corporation Selection of obscured computer-generated objects

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
COFFIN C ET AL: "Interactive Perspective Cut-away Views for General 3D Scenes", 3D USER INTERFACES, 2006. IEEE SYMPOSIUM ON ALEXANDRIA, VA, USA MARCH 25-26, 2006, PISCATAWAY, NJ, USA,IEEE, 25 March 2006 (2006-03-25), pages 25 - 28, XP010923844, ISBN: 978-1-4244-0225-0 *
LI W ET AL: "Interactive cutaway illustrations of complex 3D models", ACM TRANSACTIONS ON GRAPHICS ACM USA, vol. 26, no. 3, 31, July 2007 (2007-07-01), pages 31-1 - 31-11, XP002757354, ISSN: 0730-0301 *
PINDAT C ET AL: "Drilling into complex 3D models with gimlenses", PROCEEDINGS OF THE ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST - PROCEEDINGS OF THE 19TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2013 2013 ASSOCIATION FOR COMPUTING MACHINERY USA, 2013, pages 223 - 230, XP002757353, DOI: 10.1145/2503713.2503714 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3460763A1 (en) 2017-09-20 2019-03-27 Dassault Systèmes A computer-implemented method of displaying a subset of a digitally modeled assembly of objects
US11176759B2 (en) 2017-09-20 2021-11-16 Dassault Systemes Computer-implemented method of displaying a subset of a digitally modeled assembly of objects

Also Published As

Publication number Publication date
CN106991205A (en) 2017-07-28
JP2017097864A (en) 2017-06-01
CN106991205B (en) 2022-03-15
US10162476B2 (en) 2018-12-25
EP3168813B1 (en) 2020-06-17
US20170131866A1 (en) 2017-05-11
JP6994825B2 (en) 2022-01-14

Similar Documents

Publication Publication Date Title
US10162476B2 (en) Computer-implemented method of displaying an assembly of digitally modeled objects revealing hidden objects
US11752431B2 (en) Systems and methods for rendering a virtual content object in an augmented reality environment
US10713826B2 (en) Computer-implemented method for drawing a polyline in a three-dimensional scene
WO2015140813A1 (en) Interactive display system with screen cut-to-shape of displayed object for realistic visualization and user interaction
EP3649621B1 (en) 3d modelling for 3d printing of objects having zero-thickness parts
WO2018203029A1 (en) System and method of 3d print modelling
JP2017097864A5 (en)
DE112018004219T5 (en) Information processing device, information processing method and program
JP7475120B2 (en) Method for generating a movement that includes at least a rotation - Patents.com
CN110060328B (en) Method for defining a drawing plane for the design of a 3D object
CN108090247A (en) For simulate take posture be particularly for see target posture body computer implemented method
EP3644198B1 (en) 3d design of b-rep skin
US9996234B2 (en) One click photo rotation
US20130090895A1 (en) Device and associated methodology for manipulating three-dimensional objects
US11176759B2 (en) Computer-implemented method of displaying a subset of a digitally modeled assembly of objects
JP2019114256A (en) Gesture-based manipulator for rotation
WO2020129660A1 (en) Three-dimensional model editing device, three-dimensional model editing method, and program
US10497183B2 (en) Computer implemented method for designing a three-dimensional modeled object comprising a curve and a point place on the curve
US20240054600A1 (en) Modifying parametric continuity of digital image content in piecewise parametric patch deformations
JP2020013390A (en) Information processing apparatus, information processing program, and information processing method
JP2008259703A (en) Object region display method, device and program
JP4310909B2 (en) Image processing device
JP2021111377A (en) Unlock of 3d view
JP2021033887A (en) Input reception and input display method in three-dimensional space, program, input reception and input display device in three-dimensional space
CN114648619A (en) Method for designing 3D objects by using virtual 3D meshes and hand-drawn sketches

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20171019

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200210

RIN1 Information on inventor provided before grant (corrected)

Inventor name: DELFINO, CHRISTOPHE

Inventor name: ARQUES, NICOLAS

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015054296

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1282273

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200715

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200917

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200918

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200917

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1282273

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201019

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201017

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015054296

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

26N No opposition filed

Effective date: 20210318

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201110

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201110

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200617

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230529

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231019

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20231026

Year of fee payment: 9

Ref country code: IT

Payment date: 20231026

Year of fee payment: 9

Ref country code: FR

Payment date: 20231024

Year of fee payment: 9

Ref country code: DE

Payment date: 20231017

Year of fee payment: 9