EP3406076A4 - Holographic video capture and telepresence system - Google Patents

Holographic video capture and telepresence system Download PDF

Info

Publication number
EP3406076A4
EP3406076A4 EP17742125.2A EP17742125A EP3406076A4 EP 3406076 A4 EP3406076 A4 EP 3406076A4 EP 17742125 A EP17742125 A EP 17742125A EP 3406076 A4 EP3406076 A4 EP 3406076A4
Authority
EP
European Patent Office
Prior art keywords
video capture
telepresence system
holographic video
holographic
telepresence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17742125.2A
Other languages
German (de)
French (fr)
Other versions
EP3406076B1 (en
EP3406076A1 (en
Inventor
Gerard Dirk Smits
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP3406076A1 publication Critical patent/EP3406076A1/en
Publication of EP3406076A4 publication Critical patent/EP3406076A4/en
Application granted granted Critical
Publication of EP3406076B1 publication Critical patent/EP3406076B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/324—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/363—Image reproducers using image projection screens
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005—Adaptation of holography to specific applications
    • G03H2001/0088—Adaptation of holography to specific applications for video-holography, i.e. integrating hologram acquisition, transmission and display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/001—Constructional or mechanical details
EP17742125.2A 2016-01-20 2017-01-23 Holographic video capture and telepresence system Active EP3406076B1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662388334P 2016-01-20 2016-01-20
US201662389372P 2016-02-23 2016-02-23
US15/411,959 US9813673B2 (en) 2016-01-20 2017-01-20 Holographic video capture and telepresence system
PCT/US2017/014616 WO2017127832A1 (en) 2016-01-20 2017-01-23 Holographic video capture and telepresence system

Publications (3)

Publication Number Publication Date
EP3406076A1 EP3406076A1 (en) 2018-11-28
EP3406076A4 true EP3406076A4 (en) 2019-08-28
EP3406076B1 EP3406076B1 (en) 2022-08-10

Family

ID=59315132

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17742125.2A Active EP3406076B1 (en) 2016-01-20 2017-01-23 Holographic video capture and telepresence system

Country Status (4)

Country Link
US (3) US9813673B2 (en)
EP (1) EP3406076B1 (en)
CN (1) CN108886601B (en)
WO (1) WO2017127832A1 (en)

Families Citing this family (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8282222B2 (en) 2007-10-10 2012-10-09 Gerard Dirk Smits Image projector with reflected light tracking
JP6143469B2 (en) * 2013-01-17 2017-06-07 キヤノン株式会社 Information processing apparatus, information processing method, and program
US10708545B2 (en) * 2018-01-17 2020-07-07 Duelight Llc System, method, and computer program for transmitting face models based on face data points
US9810913B2 (en) 2014-03-28 2017-11-07 Gerard Dirk Smits Smart head-mounted projection system
US9377533B2 (en) 2014-08-11 2016-06-28 Gerard Dirk Smits Three-dimensional triangulation and time-of-flight based tracking systems and methods
US10043282B2 (en) 2015-04-13 2018-08-07 Gerard Dirk Smits Machine vision for ego-motion, segmenting, and classifying objects
WO2017106875A1 (en) 2015-12-18 2017-06-22 Gerard Dirk Smits Real time position sensing of objects
US9813673B2 (en) * 2016-01-20 2017-11-07 Gerard Dirk Smits Holographic video capture and telepresence system
CN108780584B (en) * 2016-03-21 2023-04-21 葫芦有限责任公司 Conversion and preprocessing of spherical video for streaming and rendering
US10067230B2 (en) 2016-10-31 2018-09-04 Gerard Dirk Smits Fast scanning LIDAR with dynamic voxel probing
WO2018125850A1 (en) 2016-12-27 2018-07-05 Gerard Dirk Smits Systems and methods for machine perception
US10671881B2 (en) 2017-04-11 2020-06-02 Microsoft Technology Licensing, Llc Image processing system with discriminative control
EP3622333A4 (en) 2017-05-10 2021-06-23 Gerard Dirk Smits Scan mirror systems and methods
US10843686B2 (en) * 2017-06-08 2020-11-24 Envisics Ltd Augmented reality (AR) visualization of advanced driver-assistance system
US10354573B2 (en) * 2017-07-25 2019-07-16 Lenovo (Singapore) Pte Ltd Screen color calibration
EP3445138A1 (en) * 2017-08-17 2019-02-20 Philips Lighting Holding B.V. Storing a preference for a light state of a light source in dependence on an attention shift
US10542238B2 (en) * 2017-09-22 2020-01-21 Faro Technologies, Inc. Collaborative virtual reality online meeting platform
WO2019079750A1 (en) 2017-10-19 2019-04-25 Gerard Dirk Smits Methods and systems for navigating a vehicle including a novel fiducial marker system
US10460512B2 (en) 2017-11-07 2019-10-29 Microsoft Technology Licensing, Llc 3D skeletonization using truncated epipolar lines
CN107657841A (en) * 2017-11-16 2018-02-02 岭南师范学院 A kind of CAD instructional devices and system based on line holographic projections
CN108111784B (en) * 2017-12-22 2020-06-26 成都先锋材料有限公司 Biological living body image monitoring system
US10504274B2 (en) 2018-01-05 2019-12-10 Microsoft Technology Licensing, Llc Fusing, texturing, and rendering views of dynamic three-dimensional models
JP7420383B2 (en) * 2018-01-14 2024-01-23 ライト フィールド ラボ、インコーポレイテッド Systems and methods for lateral energy localization in energy relays using ordered structures
US10379220B1 (en) 2018-01-29 2019-08-13 Gerard Dirk Smits Hyper-resolved, high bandwidth scanned LIDAR systems
EP3522539A1 (en) * 2018-02-01 2019-08-07 Vrije Universiteit Brussel Method and apparatus for compensating motion for a holographic video stream
US10298921B1 (en) 2018-02-27 2019-05-21 Looking Glass Factory, Inc. Superstereoscopic display with enhanced off-angle separation
CN110324559B (en) * 2018-03-28 2021-11-30 北京富纳特创新科技有限公司 Video communication apparatus and method
US10935376B2 (en) 2018-03-30 2021-03-02 Koninklijke Philips N.V. System and method for 3D scanning
US11422441B2 (en) 2018-04-16 2022-08-23 Sony Corporation Image display apparatus with reflection regions
US10928569B2 (en) * 2018-04-24 2021-02-23 Palo Alto Research Center Incorporated Angle-insensitive multi-wavelength optical filters with hue control
CN112074770B (en) * 2018-05-04 2023-08-22 哈曼国际工业有限公司 Adjustable three-dimensional augmented reality head-up display
US10623791B2 (en) 2018-06-01 2020-04-14 At&T Intellectual Property I, L.P. Field of view prediction in live panoramic video streaming
US10812774B2 (en) 2018-06-06 2020-10-20 At&T Intellectual Property I, L.P. Methods and devices for adapting the rate of video content streaming
US10616621B2 (en) 2018-06-29 2020-04-07 At&T Intellectual Property I, L.P. Methods and devices for determining multipath routing for panoramic video content
US11019361B2 (en) 2018-08-13 2021-05-25 At&T Intellectual Property I, L.P. Methods, systems and devices for adjusting panoramic view of a camera for capturing video content
US10708494B2 (en) 2018-08-13 2020-07-07 At&T Intellectual Property I, L.P. Methods, systems and devices for adjusting panoramic video content
US10725536B2 (en) * 2018-08-21 2020-07-28 Disney Enterprises, Inc. Virtual indicium display system for gaze direction in an image capture environment
US11187914B2 (en) 2018-09-28 2021-11-30 Apple Inc. Mirror-based scene cameras
CN112752992B (en) 2018-09-28 2023-10-31 苹果公司 Mixed reality or virtual reality camera system
DE102018129143B4 (en) * 2018-11-20 2021-06-17 Carl Zeiss Industrielle Messtechnik Gmbh Variable measurement object-dependent camera structure and calibration thereof
US10930183B2 (en) * 2018-11-22 2021-02-23 Electronics And Telecommunications Research Institute Hologram content generation apparatus, integrated hologram content control system having the same, and method for operating the hologram content generation apparatus
CN109683461B (en) * 2019-01-24 2020-11-10 杭州光粒科技有限公司 Hologram generation method and system based on light field rendering, storage medium and near-to-eye AR holographic three-dimensional display system
US10956762B2 (en) * 2019-03-29 2021-03-23 Advanced New Technologies Co., Ltd. Spoof detection via 3D reconstruction
US11308618B2 (en) 2019-04-14 2022-04-19 Holovisions LLC Healthy-Selfie(TM): a portable phone-moving device for telemedicine imaging using a mobile phone
CN112036222B (en) * 2019-06-04 2023-12-29 星宸科技股份有限公司 Face recognition system and method
DE102019208316A1 (en) * 2019-06-07 2020-12-10 Audi Ag Method for operating a video conference system as well as a video conference system and a motor vehicle
US10984270B2 (en) 2019-06-21 2021-04-20 Advanced New Technologies Co., Ltd. Spoof detection by estimating subject motion from captured image frames
CN112307848B (en) * 2019-08-01 2024-04-30 惠普发展公司，有限责任合伙企业 Detecting spoofed speakers in video conferencing
JP2022552770A (en) * 2019-08-09 2022-12-20 ライト フィールド ラボ、インコーポレイテッド Digital Signage System Based on the Light Field Display System Inventors: Jonathan Shan Calaffin, Brendan Elwood Bevensey, John Dome
KR20220054619A (en) * 2019-09-03 2022-05-03 라이트 필드 랩 인코포레이티드 Lightfield display for mobile devices
CN115280363A (en) * 2019-11-01 2022-11-01 前瞻机械私人有限公司 System and method for generating and/or using 3-dimensional information with camera array
CN111444755B (en) * 2019-11-01 2020-11-13 爱保科技有限公司 Alert grade lifting system based on scene detection big data and corresponding terminal
CN111131608B (en) * 2019-12-16 2021-03-30 深圳宝路西智能科技有限公司 Message prompting method for smart watch
CN111385514B (en) * 2020-02-18 2021-06-29 华为技术有限公司 Portrait processing method and device and terminal
WO2021174227A1 (en) 2020-02-27 2021-09-02 Gerard Dirk Smits High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array
CN111640119B (en) * 2020-04-09 2023-11-17 北京邮电大学 Image processing method, processing device, electronic equipment and storage medium
CN111626140A (en) * 2020-04-30 2020-09-04 江苏奥帆科技有限公司 System and method for rapidly identifying image of beverage package
DE102020206392A1 (en) * 2020-05-20 2021-11-25 Gixel GmbH Glasses display system for displaying a virtual image in a user's field of view
WO2021237065A1 (en) 2020-05-21 2021-11-25 Looking Glass Factory, Inc. System and method for holographic image display
US11415935B2 (en) * 2020-06-23 2022-08-16 Looking Glass Factory, Inc. System and method for holographic communication
CN112468832A (en) * 2020-10-22 2021-03-09 北京拙河科技有限公司 Billion-level pixel panoramic video live broadcast method, device, medium and equipment
CN112437320A (en) * 2020-11-10 2021-03-02 维沃移动通信有限公司 Video image display method and device, electronic equipment and readable storage medium
US11388388B2 (en) 2020-12-01 2022-07-12 Looking Glass Factory, Inc. System and method for processing three dimensional images
US11622100B2 (en) * 2021-02-17 2023-04-04 flexxCOACH VR 360-degree virtual-reality system for dynamic events
US11750971B2 (en) 2021-03-11 2023-09-05 Nanning Fulian Fugui Precision Industrial Co., Ltd. Three-dimensional sound localization method, electronic device and computer readable storage
EP4323186A1 (en) 2021-04-12 2024-02-21 Saint-Gobain Glass France Projection arrangement comprising a composite pane
CN113112580B (en) * 2021-04-20 2022-03-25 北京字跳网络技术有限公司 Method, device, equipment and medium for generating virtual image
US20220366799A1 (en) * 2021-05-14 2022-11-17 Rockwell Collins, Inc. Neuromorphic cameras for aircraft
US20230162531A1 (en) * 2021-11-22 2023-05-25 Microsoft Technology Licensing, Llc Interpretation of resonant sensor data using machine learning
US11663895B1 (en) 2021-12-13 2023-05-30 Kyndryl, Inc. Virtual three-dimensional holographic safety gate
CN113917701B (en) * 2021-12-14 2022-02-18 成都工业学院 Projection light field stereoscopic display device
WO2023132971A1 (en) * 2022-11-03 2023-07-13 Innopeak Technology, Inc. Volumetric transparency and shadows for mobile graphics
CN115866189B (en) * 2023-03-01 2023-05-16 吉视传媒股份有限公司 Video data safety transmission method for cloud conference
CN116824029B (en) * 2023-07-13 2024-03-08 北京弘视科技有限公司 Method, device, electronic equipment and storage medium for generating holographic shadow

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110115747A1 (en) * 2009-11-17 2011-05-19 Karlton Powell Infrared vision with liquid crystal display device

Family Cites Families (170)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3170329A (en) 1961-10-02 1965-02-23 Merck & Co Inc Temperature monitoring apparatus
US4019262A (en) 1975-12-22 1977-04-26 The United States Of America As Represented By The Secretary Of The Navy Direct fire weapon trainer incorporating hit and data delay responses
GB2043940A (en) 1979-01-11 1980-10-08 Redifon Simulation Ltd Visual Display Apparatus
US5506682A (en) 1982-02-16 1996-04-09 Sensor Adaptive Machines Inc. Robot vision using targets
US5559322A (en) 1985-03-11 1996-09-24 Trw Inc. Imaging optical tracker
US4820041A (en) 1986-11-12 1989-04-11 Agtek Development Co., Inc. Position sensing system for surveying and grading
US5052820A (en) 1987-06-08 1991-10-01 Electric Power Research Institute, Inc. Thermal refractive materials for optical sensor application
JP2555611B2 (en) 1987-06-26 1996-11-20 ミノルタ株式会社 Micro image processor
US5115230A (en) 1989-07-19 1992-05-19 Bell Communications Research, Inc. Light-pen system for projected images
AU642469B2 (en) 1990-01-31 1993-10-21 De La Rue International Limited Image handling
US5107122A (en) 1990-10-12 1992-04-21 Hughes Aircraft Company Sparse readout method and apparatus for a pixel array
CA2085735A1 (en) 1991-04-22 1992-10-23 Ralph W. Fisher Head-mounted projection display system featuring beam splitter
US5245398A (en) 1991-06-21 1993-09-14 Eastman Kodak Company Time-multiplexed multi-zone rangefinder
US5218427A (en) 1991-09-06 1993-06-08 Koch Stephen K Ranging system for three-dimensional object digitizing
DE4204821A1 (en) 1992-02-18 1993-08-19 Burkhard Katz METHOD AND DEVICE FOR PRESENTING PRESENTATIONS BEFORE PASSENGERS OF MOVING VEHICLES
US5455588A (en) 1993-03-01 1995-10-03 Lew; Hyok S. Method for determining target velocity by measuring phase shift
JPH07261920A (en) 1994-03-17 1995-10-13 Wacom Co Ltd Optical position detector and optical coordinate input device
DE69528212T2 (en) 1994-06-09 2003-04-24 Corp For Nat Res Initiatives R Note device interface
US5661506A (en) 1994-11-10 1997-08-26 Sia Technology Corporation Pen and paper information recording system using an imaging pen
DE69532978T2 (en) 1994-12-16 2005-06-16 Hyundai Electronics America, Milpitas Apparatus and method for a digitizing stylus
US5677795A (en) 1995-01-10 1997-10-14 Hughes Aircraft Company Modular helmet-mounted display
JPH09212648A (en) 1996-01-31 1997-08-15 Toshiba Corp Moving image processing method
US5812664A (en) 1996-09-06 1998-09-22 Pitney Bowes Inc. Key distribution system
US6115022A (en) 1996-12-10 2000-09-05 Metavision Corporation Method and apparatus for adjusting multiple projected raster images
US5914783A (en) 1997-03-24 1999-06-22 Mistubishi Electric Information Technology Center America, Inc. Method and apparatus for detecting the location of a light source
JPH11119184A (en) 1997-10-20 1999-04-30 Fujitsu General Ltd Automatic focusing device for liquid crystal projector
CA2233047C (en) 1998-02-02 2000-09-26 Steve Mann Wearable camera system with viewfinder means
US6535182B2 (en) 1998-12-07 2003-03-18 Koninklijke Philips Electronics N.V. Head-mounted projection display system
JP2002531576A (en) 1998-12-10 2002-09-24 エフ．ホフマン−ラ ロシュ アーゲー Procollagen C-proteinase inhibitor
US6545670B1 (en) 1999-05-11 2003-04-08 Timothy R. Pryor Methods and apparatus for man machine interfaces and related activity
US6987573B1 (en) 1999-05-25 2006-01-17 Silverbrook Research Pty Ltd Interface surface printer
JP2001045381A (en) 1999-08-02 2001-02-16 Sony Corp Picture processor and picture processing method and medium
US7262765B2 (en) 1999-08-05 2007-08-28 Microvision, Inc. Apparatuses and methods for utilizing non-ideal light sources
JP2001075736A (en) 1999-09-06 2001-03-23 Canon Inc Coordinate input device
AU2001249133A1 (en) 2000-03-09 2001-09-17 The Johns-Hopkins University Force detected magnetic field gradiometer
JP3994672B2 (en) 2000-03-31 2007-10-24 セイコーエプソン株式会社 Detection of indicated position using image processing
US7289110B2 (en) 2000-07-17 2007-10-30 Human Messaging Ab Method and arrangement for identifying and processing commands in digital images, where the user marks the command, for example by encircling it
US6535275B2 (en) 2000-08-09 2003-03-18 Dialog Semiconductor Gmbh High resolution 3-D imaging range finder
EP1191306B1 (en) 2000-09-26 2006-11-22 Fuji Photo Film Co., Ltd. Distance information obtaining apparatus and distance information obtaining method
US20020039138A1 (en) 2000-09-29 2002-04-04 Edelson Steven D. Method and apparatus for automatically adjusting video panning and zoom rates
US6607527B1 (en) 2000-10-17 2003-08-19 Luis Antonio Ruiz Method and apparatus for precision laser surgery
US6704000B2 (en) 2000-11-15 2004-03-09 Blue Iris Technologies Method for remote computer operation via a wireless optical device
US6543899B2 (en) 2000-12-05 2003-04-08 Eastman Kodak Company Auto-stereoscopic viewing system using mounted projection
US6774869B2 (en) 2000-12-22 2004-08-10 Board Of Trustees Operating Michigan State University Teleportal face-to-face system
US7002549B2 (en) 2001-01-18 2006-02-21 Mccahon Stephen William Optically based machine input control device
US20020100884A1 (en) 2001-01-29 2002-08-01 Maddock Brian L.W. Digital 3-D model production method and apparatus
US7203383B2 (en) 2001-02-22 2007-04-10 Thinkpen Llc Handwritten character recording and recognition device
JP4530571B2 (en) 2001-04-16 2010-08-25 Ｈｏｙａ株式会社 3D image detection device
JP2003029201A (en) 2001-07-11 2003-01-29 Canon Inc Picture projecting device and picture correcting method
US6448576B1 (en) 2001-08-30 2002-09-10 Bae Systems Information And Electronic Systems Integration, Inc. Programmable chalcogenide fuse within a semiconductor device
EP1419411B1 (en) 2001-10-05 2005-01-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Projection device
AU2003210440A1 (en) 2002-01-04 2003-07-24 Neurok Llc Three-dimensional image projection employing retro-reflective screens
GB0203530D0 (en) 2002-02-14 2002-04-03 Lettington Alan H Scanning apparatus
US6894823B2 (en) 2002-04-26 2005-05-17 Corning Intellisense Llc Magnetically actuated microelectromechanical devices and method of manufacture
US7349553B2 (en) 2002-04-29 2008-03-25 The Boeing Company Watermarks for secure distribution of digital data
JP4147054B2 (en) 2002-05-17 2008-09-10 オリンパス株式会社 Stereoscopic observation device
US20030222849A1 (en) 2002-05-31 2003-12-04 Starkweather Gary K. Laser-based user input device for electronic projection displays
US20040006424A1 (en) 2002-06-28 2004-01-08 Joyce Glenn J. Control system for tracking and targeting multiple autonomous objects
JP4228131B2 (en) 2002-10-11 2009-02-25 株式会社トプコン Position measuring device
EP1557038A4 (en) 2002-10-30 2009-05-13 Nds Ltd Interactive broadcast system
US7119965B1 (en) 2003-02-24 2006-10-10 University Of Central Florida Research Foundation, Inc. Head mounted projection display with a wide field of view
JP4517601B2 (en) 2003-07-09 2010-08-04 ソニー株式会社 Projection type image display device
US7359041B2 (en) 2003-09-04 2008-04-15 Avago Technologies Ecbu Ip Pte Ltd Method and system for optically tracking a target using a triangulation technique
JP3831946B2 (en) 2003-09-26 2006-10-11 ソニー株式会社 Imaging device
JP4206928B2 (en) 2004-01-19 2009-01-14 株式会社デンソー Collision possibility judgment device
WO2005082075A2 (en) 2004-02-25 2005-09-09 The University Of North Carolina At Chapel Hill Systems and methods for imperceptibly embedding structured light patterns in projected color images
JP2005249905A (en) 2004-03-02 2005-09-15 Canon Inc Projection display device
US7023536B2 (en) 2004-03-08 2006-04-04 Electronic Scripting Products, Inc. Apparatus and method for determining orientation parameters of an elongate object
EP1584946A3 (en) 2004-04-02 2006-03-22 Omron Corporation Method of adjusting monitor axis of optical sensors
US8153975B2 (en) 2004-12-01 2012-04-10 White Box, Inc. Interfacing devices and systems
JP4483703B2 (en) 2004-08-04 2010-06-16 セイコーエプソン株式会社 projector
US20060028374A1 (en) 2004-08-06 2006-02-09 Time Domain Corporation System and method for ultra wideband subarray beam steering
US8115728B2 (en) 2005-03-09 2012-02-14 Sharp Laboratories Of America, Inc. Image display device with reduced flickering and blur
US20060132447A1 (en) 2004-12-16 2006-06-22 Conrad Richard H Method and apparatus for automatically transforming functions of computer keyboard keys and pointing devices by detection of hand location
DE102004060576B4 (en) 2004-12-16 2017-12-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and projector for image projection
US7283301B2 (en) 2004-12-17 2007-10-16 Palo Alto Research Center Incorporated Emissive screen display with laser-based external addressing
US7232229B2 (en) 2004-12-17 2007-06-19 Palo Alto Research Center Incorporated Laser-based display with position sensitive detector
US7278745B2 (en) 2004-12-21 2007-10-09 Infocus Corporation Method and apparatus for adjusting relative disposition of projection optics based on operating conditions
US7375804B2 (en) 2005-03-01 2008-05-20 Lockheed Martin Corporation Single detector receiver for multi-beam LADAR systems
US7911444B2 (en) 2005-08-31 2011-03-22 Microsoft Corporation Input method for surface of interactive display
US7672504B2 (en) 2005-09-01 2010-03-02 Childers Edwin M C Method and system for obtaining high resolution 3-D images of moving objects by use of sensor fusion
WO2007025363A1 (en) 2005-09-02 2007-03-08 Neptec Apparatus and method for tracking an object
JP4508049B2 (en) 2005-09-05 2010-07-21 株式会社日立製作所 360 ° image capturing device
US20060256133A1 (en) 2005-11-05 2006-11-16 Outland Research Gaze-responsive video advertisment display
US7787134B2 (en) 2005-11-09 2010-08-31 The Boeing Company Multiple fanned laser beam metrology system
US20080317077A1 (en) 2005-12-13 2008-12-25 Koninklijke Philips Electronics, N.V. Device and Method for Laser Safe Operation
US7348528B2 (en) 2005-12-20 2008-03-25 Marshall Daniel R Distance measuring system
US8355117B2 (en) 2005-12-21 2013-01-15 Ecole Polytechnique Federale De Lausanne Method and arrangement for measuring the distance to an object
US9323055B2 (en) 2006-05-26 2016-04-26 Exelis, Inc. System and method to display maintenance and operational instructions of an apparatus using augmented reality
US20080018591A1 (en) 2006-07-20 2008-01-24 Arkady Pittel User Interfacing
GB0616838D0 (en) 2006-08-25 2006-10-04 Moir Christopher I Velocity detector
US8259239B2 (en) 2007-01-18 2012-09-04 The Arizona Board Of Regents On Behalf Of The University Of Arizona Polarized head-mounted projection display
KR100939501B1 (en) 2007-02-20 2010-01-29 재단법인대구경북과학기술원 Multimedia player displaying 2 projection images
WO2008106999A1 (en) 2007-03-08 2008-09-12 Trimble Ab Methods and instruments for estimating target motion
JP2008275460A (en) 2007-04-27 2008-11-13 Mitsubishi Electric Corp Radar device
US8169447B2 (en) 2007-05-22 2012-05-01 International Business Machines Corporation Automatic color display conversion
US7667598B2 (en) 2007-06-19 2010-02-23 Lockheed Martin Corporation Method and apparatus for detecting presence and range of a target object using a common detector
US9939233B2 (en) 2007-10-02 2018-04-10 Doubleshot, Inc. Laser beam pattern projector
US8282222B2 (en) 2007-10-10 2012-10-09 Gerard Dirk Smits Image projector with reflected light tracking
US7554652B1 (en) 2008-02-29 2009-06-30 Institut National D'optique Light-integrating rangefinding device and method
WO2009111003A1 (en) 2008-03-03 2009-09-11 David Chaum Hidden-code voting and marking systems
US7905567B2 (en) 2008-05-16 2011-03-15 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Closed-loop printing registration systems, devices, components and methods
US8531650B2 (en) 2008-07-08 2013-09-10 Chiaro Technologies LLC Multiple channel locating
CN101796372B (en) * 2008-07-11 2012-11-14 松下电器产业株式会社 Three-dimensional shape measuring device, integrated circuit, and method
JP2010025759A (en) 2008-07-18 2010-02-04 Fuji Xerox Co Ltd Position measuring system
CN102113015B (en) 2008-07-28 2017-04-26 皇家飞利浦电子股份有限公司 Use of inpainting techniques for image correction
GB0818449D0 (en) 2008-10-09 2008-11-12 Uk Meter Exchange The Ltd Remote metering device
WO2010052593A1 (en) 2008-11-04 2010-05-14 Ecole Polytechnique Federale De Lausanne (Epfl) Camera design for the simultaneous capture of near-infrared and visible images
US20100142856A1 (en) 2008-12-10 2010-06-10 Shin Takeuchi Image reading apparatus, and reading method
US8810796B2 (en) 2009-04-21 2014-08-19 Michigan Aerospace Corporation Light processing system and method
MY158884A (en) 2009-05-01 2016-11-30 Xtralis Technologies Ltd Particle detectors
WO2011049025A1 (en) * 2009-10-20 2011-04-28 シャープ株式会社 Three dimensional video display device
US8123928B2 (en) 2009-12-22 2012-02-28 Rio Tinto Alcan International Limited Shut-down and start-up procedures of an electrolytic cell
US8573783B2 (en) 2010-03-01 2013-11-05 Gerard Dirk Smits Safety device for scanned projector and illumination systems
US8411135B2 (en) 2010-03-17 2013-04-02 Seiko Epson Corporation Methods to eliminate/reduce the crosstalk artifacts of the retro-reflective auto-stereoscopic 3D display
KR101190125B1 (en) 2010-04-16 2012-10-11 주식회사 고영테크놀러지 Method of three dimensional mesurement
US9151607B2 (en) 2010-05-31 2015-10-06 University Of North Carolina At Charlotte Dimensional measurement through a combination of photogrammetry and optical scattering
WO2011154950A1 (en) 2010-06-11 2011-12-15 N-Trig Ltd. Object orientation detection with a digitizer
TWI540312B (en) 2010-06-15 2016-07-01 原相科技股份有限公司 Time of flight system capable of increasing measurement accuracy, saving power and/or increasing motion detection rate and method thereof
US9134799B2 (en) 2010-07-16 2015-09-15 Qualcomm Incorporated Interacting with a projected user interface using orientation sensors
WO2012033175A1 (en) 2010-09-08 2012-03-15 大日本印刷株式会社 Lighting device, projection device, and projection footage display device
US9946076B2 (en) 2010-10-04 2018-04-17 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity
KR101706093B1 (en) 2010-11-30 2017-02-14 삼성전자주식회사 System for extracting 3-dimensional coordinate and method thereof
US8957847B1 (en) 2010-12-28 2015-02-17 Amazon Technologies, Inc. Low distraction interfaces
US8780161B2 (en) * 2011-03-01 2014-07-15 Hewlett-Packard Development Company, L.P. System and method for modifying images
US8493573B2 (en) 2011-03-09 2013-07-23 The United States Of America As Represented By The Secretary Of The Army High-resolution optical position sensing with sparse, low-resolution detectors
US8953242B2 (en) 2011-03-31 2015-02-10 Honeywell International Inc. Varible focus stereoscopic display system and method
US9026596B2 (en) * 2011-06-16 2015-05-05 Microsoft Technology Licensing, Llc Sharing of event media streams
US8773512B1 (en) 2011-06-30 2014-07-08 Aquifi, Inc. Portable remote control device enabling three-dimensional user interaction with at least one appliance
CN102890574A (en) 2011-07-21 2013-01-23 鸿富锦精密工业（深圳）有限公司 Touch device and mouse using same
DE102011081428A1 (en) 2011-08-23 2013-02-28 Robert Bosch Gmbh A method of determining an object class of an object from which light is emitted and / or reflected to a vehicle
US9366519B2 (en) 2011-10-06 2016-06-14 Renishaw Plc Measurement method
JP5783568B2 (en) 2011-10-31 2015-09-24 国立大学法人九州大学 Micro scanner
EP2589980A1 (en) 2011-11-04 2013-05-08 Leica Geosystems AG Distance sensor
JP5909365B2 (en) 2012-01-05 2016-04-26 株式会社ミツトヨ Contact probe
EP2618175A1 (en) 2012-01-17 2013-07-24 Leica Geosystems AG Laser tracker with graphical targeting functionality
US8947755B2 (en) 2012-02-21 2015-02-03 Hitachi-Lg Data Storage Inc. Optical scanning device and image display apparatus
US9131192B2 (en) 2012-03-06 2015-09-08 Apple Inc. Unified slider control for modifying multiple image properties
JP6345171B2 (en) 2012-04-18 2018-06-20 レニショウ パブリック リミテッド カンパニーＲｅｎｉｓｈａｗ Ｐｕｂｌｉｃ Ｌｉｍｉｔｅｄ Ｃｏｍｐａｎｙ Measuring method in machine tool and corresponding machine tool device
US20130300670A1 (en) 2012-05-09 2013-11-14 Research In Motion Limited Computer input stylus with multiple antennas
US9244339B2 (en) 2012-06-15 2016-01-26 Mirraviz, Inc. Systems and methods for displaying an image or video on a retro-reflective screen
US9562764B2 (en) 2012-07-23 2017-02-07 Trimble Inc. Use of a sky polarization sensor for absolute orientation determination in position determining systems
US8711370B1 (en) 2012-10-04 2014-04-29 Gerard Dirk Smits Scanning optical positioning system with spatially triangulating receivers
US8994780B2 (en) 2012-10-04 2015-03-31 Mcci Corporation Video conferencing enhanced with 3-D perspective control
US9854196B2 (en) * 2012-11-28 2017-12-26 Beijing Lenovo Software Ltd. Head-mounted electronic device and audio processing method
US20140273752A1 (en) 2013-03-13 2014-09-18 Applied Materials, Inc. Pad conditioning process control using laser conditioning
US9392225B2 (en) * 2013-03-14 2016-07-12 Polycom, Inc. Method and system for providing a virtual cafeteria
US9041914B2 (en) 2013-03-15 2015-05-26 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
EP2972081B1 (en) 2013-03-15 2020-04-22 Apple Inc. Depth scanning with multiple emitters
US9702977B2 (en) 2013-03-15 2017-07-11 Leap Motion, Inc. Determining positional information of an object in space
CN105247861B (en) * 2013-03-22 2017-11-10 精工爱普生株式会社 Infrared video shows glasses
US20150091815A1 (en) 2013-10-01 2015-04-02 Avaya Inc. Method and Apparatus to Support Visually Impaired Users of Touchscreen Based User Interfaces
WO2015120452A1 (en) 2014-02-10 2015-08-13 Lockheed Martin Corporation Nondestructive collection of evidence
US9952033B2 (en) 2014-02-14 2018-04-24 Palo Alto Research Center Incorporated Spatial modulation of light to determine object length
US9842514B2 (en) 2014-02-19 2017-12-12 Milwaukee School Of Engineering Dynamic deoxyribonucleic acid (DNA) models and kits
JP6413291B2 (en) 2014-03-27 2018-10-31 セイコーエプソン株式会社 Virtual image display device and head mounted display
US20150286293A1 (en) 2014-04-03 2015-10-08 Qualcomm Incorporated Optical stylus with deformable tip
DE102015205826B4 (en) 2014-04-04 2020-03-12 pmdtechnologies ag Distance measuring system with time-of-flight pixel line
US9952323B2 (en) 2014-04-07 2018-04-24 Samsung Electronics Co., Ltd. High resolution, high frame rate, low power image sensor
DE202014103215U1 (en) 2014-07-11 2014-09-30 Christian Stroetmann Electronic visual device having a flexible or bendable device for optical signaling of variable information, a flexible or bendable housing with at least one hinge / hinge and a control system
US9335414B2 (en) 2014-07-11 2016-05-10 Raytheon Company Frequency agile LADAR
US9377533B2 (en) 2014-08-11 2016-06-28 Gerard Dirk Smits Three-dimensional triangulation and time-of-flight based tracking systems and methods
CA2959335A1 (en) 2014-08-26 2016-03-03 Massachusetts Institute Of Technology Methods and apparatus for three-dimensional (3d) imaging
JP6312924B2 (en) 2015-03-27 2018-04-18 三菱電機株式会社 IMAGING DEVICE AND METHOD, OPERATION DEVICE AND METHOD, PROGRAM, AND RECORDING MEDIUM
US10043282B2 (en) 2015-04-13 2018-08-07 Gerard Dirk Smits Machine vision for ego-motion, segmenting, and classifying objects
KR101665938B1 (en) 2015-04-28 2016-10-13 전자부품연구원 Optical system of multi lidar scanner using mirror rotation
US9952036B2 (en) 2015-11-06 2018-04-24 Intel Corporation Systems, methods, and apparatuses for implementing maximum likelihood image binarization in a coded light range camera
US9813673B2 (en) * 2016-01-20 2017-11-07 Gerard Dirk Smits Holographic video capture and telepresence system
US10067230B2 (en) 2016-10-31 2018-09-04 Gerard Dirk Smits Fast scanning LIDAR with dynamic voxel probing
US20190080612A1 (en) 2017-09-14 2019-03-14 Qualcomm Incorporated Navigation techniques for autonomous and semi-autonomous vehicles

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110115747A1 (en) * 2009-11-17 2011-05-19 Karlton Powell Infrared vision with liquid crystal display device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
HAO LI ET AL: "Facial performance sensing head-mounted display", ACM TRANSACTIONS ON GRAPHICS, vol. 34, no. 4, 27 July 2015 (2015-07-27), 2 Penn Plaza, Suite 701New YorkNY10121-0701USA, pages 47:1 - 47:9, XP055346825, ISSN: 0730-0301, DOI: 10.1145/2766939 *
JANNICK P ROLLAND ET AL: "Development of Head-Mounted Projection Displays for Distributed, Collaborative, Augmented Reality Applicatio ns", PRESENCE, vol. 14, no. 5, 1 October 2005 (2005-10-01), US, pages 528 - 549, XP055606840, ISSN: 1054-7460, DOI: 10.1162/105474605774918741 *
MIKE SEYMOUR: "Facing Second Son - fxguide", 2 February 2015 (2015-02-02), pages 1 - 18, XP055607174, Retrieved from the Internet <URL:https://www.fxguide.com/fxfeatured/facing-second-son/> [retrieved on 20190719] *
See also references of WO2017127832A1 *

Also Published As

Publication number Publication date
CN108886601A (en) 2018-11-23
US9813673B2 (en) 2017-11-07
US10084990B2 (en) 2018-09-25
US20170208292A1 (en) 2017-07-20
WO2017127832A1 (en) 2017-07-27
EP3406076B1 (en) 2022-08-10
US20180063484A1 (en) 2018-03-01
EP3406076A1 (en) 2018-11-28
CN108886601B (en) 2021-07-06
US10477149B2 (en) 2019-11-12
US20190028674A1 (en) 2019-01-24

Similar Documents

Publication Publication Date Title
EP3406076A4 (en) Holographic video capture and telepresence system
EP3673647A4 (en) Methods and systems for image capture
EP3479559A4 (en) Systems and methods for capturing digital images
EP3532906A4 (en) Video tagging system and method
EP3619914A4 (en) Devices and methods for video processing
EP3467437A4 (en) Position capture method and system
EP3591279A4 (en) Camera pan-tilt and camera system
EP3354038A4 (en) Systems and methods for video processing
EP3443749A4 (en) Systems and methods for video processing and display
EP3552386A4 (en) Systems and methods for video replaying
EP3233633A4 (en) Drone based systems and methodologies for capturing images
EP3354016A4 (en) Systems and methods for video processing
EP3111430A4 (en) Emergency video camera system
EP3513563A4 (en) Methods and systems for video processing
EP3482569A4 (en) Methods and systems for video streaming
EP3726119A4 (en) Video camera
EP3337167A4 (en) Camera and surveillance system for video surveillance
EP3222039A4 (en) Video and motion event integration system
EP3155807A4 (en) Video replay systems and methods
EP3185545A4 (en) Video conference control method and system
EP3683547A4 (en) Position capturing system and position capturing method
EP3525443A4 (en) Camera lens and video camera
EP3731518A4 (en) Video decoding method and camera
EP3320683A4 (en) Methods and systems for image compression
EP3479565A4 (en) Systems and methods for video processing

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180725

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20190729

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 13/363 20180101ALI20190723BHEP

Ipc: H04N 13/344 20180101ALI20190723BHEP

Ipc: H04N 13/366 20180101ALI20190723BHEP

Ipc: H04N 7/15 20060101AFI20190723BHEP

Ipc: H04N 13/324 20180101ALI20190723BHEP

Ipc: H04N 13/243 20180101ALI20190723BHEP

Ipc: H04N 13/383 20180101ALI20190723BHEP

Ipc: H04N 13/275 20180101ALI20190723BHEP

Ipc: H04N 13/257 20180101ALI20190723BHEP

Ipc: H04N 13/239 20180101ALI20190723BHEP

Ipc: H04N 7/14 20060101ALI20190723BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20201119

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220310

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1511431

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220815

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017060497

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220810

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221212

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221110

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1511431

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220810

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221210

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017060497

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230529

26N No opposition filed

Effective date: 20230511

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602017060497

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220810

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230123

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230123

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230123

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230801

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230123