EP3015147A1 - Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant - Google Patents

Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant Download PDF

Info

Publication number
EP3015147A1
EP3015147A1 EP15190258.2A EP15190258A EP3015147A1 EP 3015147 A1 EP3015147 A1 EP 3015147A1 EP 15190258 A EP15190258 A EP 15190258A EP 3015147 A1 EP3015147 A1 EP 3015147A1
Authority
EP
European Patent Office
Prior art keywords
trajectory
camera
approximate
drone
target trajectory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP15190258.2A
Other languages
German (de)
English (en)
Inventor
Francois-Louis Tariolle
Nicolas Mollet
Julien Fleureau
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Priority to EP15190258.2A priority Critical patent/EP3015147A1/fr
Publication of EP3015147A1 publication Critical patent/EP3015147A1/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10—Simultaneous control of position or course in three dimensions
    • G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • G05D1/106—Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H27/00—Toy aircraft; Other flying toys
    • A63H27/12—Helicopters ; Flying tops
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/0094—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Definitions

  • the present disclosure relates generally to the field of the generation of a trajectory for a camera embarked on a drone for video making.
  • drones also known as Unmanned Aerial Vehicle
  • Unmanned Aerial Vehicle are now more and more integrated and easy to control, even in non-military context.
  • Many applications making use of such devices may be now found in the civil life as, for instance, surveillance, video recording or even gaming.
  • rotary-wing drones are the most developed drones on the civil market. For instance, some rotary-wing drones being controllable from a remote tablet are now available for sale to non-professional consumers. Such kinds of drones are able to embed a video camera and broadcast the data over a wireless network.
  • the trajectory of the arm can be designed off-line. But the quality of the arm trajectory is here also directly dependent on the manipulation skills of the guy moving the Louma Systems arm. It also requires a trained or a professional user.
  • trajectory is defined by demonstration (through a record of the drone path manipulated by the user), it then requires the skills to use the drone and the associated camera (point of view, movements, speed, softness, etc.), in addition to the same 3D skills for editing.
  • the disclosure concerns a method for generating a target trajectory of a camera embarked on a drone moving in an indoor or outdoor environment, said method comprising the steps of:
  • a first trajectory is captured by moving an object acting as a pseudo-camera.
  • the manual acquisition of this first trajectory which is an approximate trajectory of the target trajectory in the real environment allows taking into account obstacles in said environment (walls, ceiling, objects, furniture%) without having to describe these obstacles in software to prepare the shoot.
  • the target trajectory of the camera is equivalent to the trajectory of the drone. If the camera has at least one degree of freedom (position and/or orientation) with respect to the drone, the target trajectory is the trajectory resulting from the movement of the drone and the movement of the camera with respect to the drone.
  • the predefined camera movement is part of a collection of predefined camera movement patterns used in film making industry. These predefined camera movement patterns are for example tracking shots, panoramic movements, tilt, pan ...
  • This method also allows generating complex trajectory by method with a few numbers of steps, based on a manual acquisition in a real environment refined by automatic post processing to obtain a professional result worthy of movie director.
  • the identifying step is automatic.
  • the approximate trajectory comprises a plurality of sample points, each sample point being characterized by a 3D position, an orientation and a time stamp.
  • the movement of the object is captured by a tracking system arranged for tracking the 3D position and the orientation of the object when moved in said environment and for generating a 3D position, an orientation and a time stamp for each sample point of the approximate trajectory.
  • the method further comprises a step for modifying the timestamp and/or the 3D position and/or the orientation of at least one sample point of the approximate trajectory or the target trajectory.
  • the method further comprises a step for adding and/or deleting at least one sample points to and/or from the approximate trajectory and/or target trajectory. It allows completing the trajectory by additional segments that can be picked up in the collection of predefined camera movements.
  • the disclosure concerns also a system for generating a target trajectory of a camera embarked on a drone moving in an indoor or outdoor environment, characterized in that said system comprises:
  • the present disclosure relates to methods and systems for generating a trajectory for a camera embarked on a drone moving in an indoor or outdoor environment.
  • Many specific details of certain embodiments of the disclosure are set forth in the following description and in figures 1 to 2 to provide a thorough understanding of such embodiments.
  • One skilled in the art, however, will understand that the present disclosure may have additional embodiments, or that the present disclosure may be practiced without several of the details described in the following description.
  • the disclosure will be described in the case of an indoor environment which is the most difficult case due to the presence of numerous obstacles (walls, objects, furniture). More specifically, the disclosure will be described through the example of the owner who wants to shoot a video tour of the rooms of his museum castle. This application will help explaining the inventive method and will show the advantages of the present disclosure for such a complex and tedious work.
  • the owner of the castle wants to shoot a video tour of all the rooms of the castle in a single shot i.e. a unique continuous sequence, by using a light drone equipped with a camera.
  • this example can be transposed to any user who wants to make his own movie at home or in a particular place. It also can be applied by a real estate agent who wants to make a video of a house to be sold in order to put it on the website of his agency.
  • This example is supporting any use-case where the goal is to shoot in a simple way a video with complex but smart and smooth trajectories.
  • the castle has several floors accessible by stairs. Some interesting masterpieces must be valorized through this video. Advantageously, nobody nor mobile objects will be present or move inside the castle during the trajectory acquisition and during the video capture. Let's call the director, the person who will use our method to shoot this sequence.
  • Step S1 manual acquisition of an approximate trajectory
  • the director walks across the castle and simulates the camera movements as if he is really shooting with a real camera.
  • the movements of the pseudo-camera are tracked by a tracking localization system.
  • the director uses a real light-camera to embody the pseudo-camera for ergonomic reasons. He can also use the drone equipped with the camera that will capture the final video.
  • the director Before the director starts walking, he needs to switch on the tracking localization system that allows for acquisition at high frame rate of every single movement of the pseudo-camera, namely its position and its orientation.
  • tracking system can be:
  • Each tracking localization system which is able to provide the position and the orientation of the pseudo-camera during its moving across the castle may be used.
  • the director has to deploy the tracking system.
  • the director spreads anchors all around the outdoor walls of the castle and sticks anchors on the pseudo-camera which is the tracked object.
  • the director in the case of an optical system, he should place optical cameras all around the castle and sticks reflective markers on the pseudo-camera.
  • a computer can act as a server to get every anchor measurement and compute position and orientation of the pseudo-camera at high frame rate (100 Hz for instance) allowing to store each sample in a unique file on the computer disk.
  • Each sample consists of:
  • VRPN Virtual Reality Peripheral Network
  • Data stored in the resulting file represents the initial trajectory plan of the camera embarked on the drone, plus the knowledge on the speed of the movements as every frame provides a timestamp.
  • the director walks all across the rooms of the castle, stringing together a combination of approximate tracking shots, panoramics and so on, from rooms to rooms, from masterpiece to masterpiece, from floors to floors.
  • the director wants to have a final continuous shot. But it does not prevent from recording the initial trajectory in several times, including deleting and restarting some trajectory acquisition sequences, and concatenating different recorded sequences to build the initial trajectory. So before the following step, there could be an intermediate step to merge several small sequences dealing with position boundaries and recomputing timestamps of subsequent sequences.
  • the resulting initial trajectory is stored in an electronic file.
  • the step S1 is optional.
  • the unit processing the trajectory receives information representative of the approximate trajectory for further processing.
  • the information representative of the approximate trajectory is for example received via any wired or wireless interface.
  • Step S2 automatic post-processing to identify trajectory segments matching predefined trajectory movie patterns and application
  • the initial trajectory is analysed in order to determine if it includes some trajectory segments corresponding to predefined camera movement patterns used in movies.
  • predefined camera movement patterns used in movies in order to improve the initial trajectory.
  • predefined camera movement patterns are given hereinafter. They are listed using a vocabulary well-known by directors and cameramen. These patterns are configurable by parameters (angle, motion direction).
  • the predefined camera movement patterns are for example:
  • the director will trigger an algorithm that:
  • This algorithm is repeated until it does no more find parts of the initial trajectory matching with patterns of the collection.
  • the algorithm when a pattern is found for a part of the initial part, the algorithm can continue to find a better pattern for this part of the initial trajectory. It computes and stores a quality indicator for each found pattern in order to help the user choosing a pattern at the end of this post-processing.
  • Step S3 Replacement of segments of the initial trajectory by predefined camera movement patterns
  • a graphical user interface presents a list of all segment candidates to a replacement. They can be replaced manually or not. They can be all replaced or only a part of them depending on the director desire.
  • the part of the initial trajectory when the director staggers going forward with the camera at 90° on hi s left will be a candidate for a linear tracking shot with a -90° pa n.
  • the part of the initial trajectory when the director circles badly around a statue with the camera pointing just ahead will be a candidate for a circular tracking shot with a 0° pan.
  • Step S4 manual trajectory editing with extension and/or modification of the trajectory
  • the director edits the post-processed trajectory (resulting from the previous steps) and views it in a 3D graphical editor like Maya or Blender. He can also turn around it if he wants.
  • the director has the possibility to modify different parameters of the post processed trajectory. Different modifications are given hereinafter as examples.
  • the director can also extend the trajectory by creating some additional sample points, helped by the position of existing points. An assistance is available to help concatenation of a new segment, or cutting an existing one and adding new points between both boundaries.
  • This segment can be created and chosen directly in the collection of patterns.
  • This extension can consist in adding a segment that can not be acquired by moving the pseudo camera (step S1). For example, it can be a segment wherein the camera goes out through the open window of a room of the castle and gets back indoor by the next open window.
  • the director can also replace a segment that has not been automatically replaced (step S3) by a pattern of the collection. He can also move a single point or several ones of the trajectory, change the orientation of the camera for a single point or for selected points. For example, the portion of the initial trajectory corresponding to the moment when the director goes upstairs is very shaky and may not have been automatically identified as a linear or a helix tracking shot during the step S2. So the director may edit this portion with the graphical user interface and apply to it one of this pattern to fix it appropriately.
  • the auto-pilot controller must be capable to control in combination the drone and the camera, the final trajectory provided to the auto-pilot controller being the trajectory resulting from the movement of the drone and the movement of the camera with respect to the drone.
  • FIG. 2 is a schematic view of the global architecture of a trajectory generation system according to one non-limitative embodiment.
  • the system comprises a first module 10 for tracking the trajectory of the pseudo-camera.
  • This module can be an optical system comprising optical cameras and reflective markers, a kinect device, an inertial measurement unit (IMU) or an Ultra-High band system with anchors.
  • the module 10 outputs a first trajectory which is an approximation of the target trajectory.
  • This approximate trajectory is then post-processed by a post-processing unit 11 that implements the steps S2 and S3 of the method.
  • the post-processing unit 11 is connected to a memory 12 storing the collections of predefined camera movements. It automatically detects trajectory segments that matches with predefined camera movements of the collection and replaces the detected trajectory segments by the corresponding predefined camera movements.
  • the post-processing unit 11 may for example take the form of one or several processors, e.g. CPUs and/or GPUs.
  • a user interface unit 13 is connected to the post-processing unit 11. The user can thus through this UI unit provide additional amendments (step S4) to the trajectory.
  • the post-processing unit outputs the final or target trajectory.
  • the implementations described herein may be implemented in, for example, a method or a process, an apparatus, a software program, a data stream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method or a device), the implementation of features discussed may also be implemented in other forms (for example a program).
  • An apparatus may be implemented in, for example, appropriate hardware, software, and firmware.
  • the methods may be implemented in, for example, an apparatus such as, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, Smartphones, tablets, computers, mobile phones, portable/personal digital assistants ("PDAs”), and other devices that facilitate communication of information between end-users.
  • PDAs portable/personal digital assistants
  • Implementations of the various processes and features described herein may be embodied in a variety of different equipment or applications, particularly, for example, equipment or applications associated with data encoding, data decoding, view generation, texture processing, and other processing of images and related texture information and/or depth information.
  • equipment include an encoder, a decoder, a post-processor processing output from a decoder, a pre-processor providing input to an encoder, a video coder, a video decoder, a video codec, a web server, a set-top box, a laptop, a personal computer, a cell phone, a PDA, and other communication devices.
  • the equipment may be mobile and even installed in a mobile vehicle.
  • implementations may produce a variety of signals formatted to carry information that may be, for example, stored or transmitted.
  • the information may include, for example, instructions for performing a method, or data produced by one of the described implementations.
  • a signal may be formatted to carry as data the rules for writing or reading the syntax of a described embodiment, or to carry as data the actual syntax-values written by a described embodiment.
  • Such a signal may be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal.
  • the formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream.
  • the information that the signal carries may be, for example, analog or digital information.
  • the signal may be transmitted over a variety of different wired or wireless links, as is known.
  • the signal may be stored on a processor-readable medium.
EP15190258.2A 2014-10-28 2015-10-16 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant Withdrawn EP3015147A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP15190258.2A EP3015147A1 (fr) 2014-10-28 2015-10-16 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP14306722.1A EP3015146A1 (fr) 2014-10-28 2014-10-28 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant
EP15190258.2A EP3015147A1 (fr) 2014-10-28 2015-10-16 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant

Publications (1)

Publication Number Publication Date
EP3015147A1 true EP3015147A1 (fr) 2016-05-04

Family

ID=51951747

Family Applications (2)

Application Number Title Priority Date Filing Date
EP14306722.1A Withdrawn EP3015146A1 (fr) 2014-10-28 2014-10-28 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant
EP15190258.2A Withdrawn EP3015147A1 (fr) 2014-10-28 2015-10-16 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP14306722.1A Withdrawn EP3015146A1 (fr) 2014-10-28 2014-10-28 Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant

Country Status (5)

Country Link
US (1) US20160117811A1 (fr)
EP (2) EP3015146A1 (fr)
JP (1) JP2016095841A (fr)
KR (1) KR20160049986A (fr)
CN (1) CN105549612A (fr)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160131720A (ko) * 2015-05-08 2016-11-16 엘지전자 주식회사 이동단말기 및 그 제어방법
US10310617B2 (en) * 2015-06-11 2019-06-04 Intel Corporation Drone controlling device and method
CN106528914A (zh) * 2016-09-21 2017-03-22 中国葛洲坝集团电力有限责任公司 一种山地光伏电站布置平台和布置方法
US10803757B2 (en) 2016-10-23 2020-10-13 Gopro, Inc. Navigation through polygonal no fly zones
KR20180064253A (ko) * 2016-12-05 2018-06-14 삼성전자주식회사 비행 제어 방법 및 이를 지원하는 전자 장치
KR101884125B1 (ko) 2017-06-13 2018-07-31 이승호 셀피용 촬영 시스템 및 이를 이용한 촬영 방법
WO2020019193A1 (fr) * 2018-07-25 2020-01-30 深圳市大疆创新科技有限公司 Procédé et système de commande de véhicule aérien sans pilote, et véhicule aérien sans pilote
KR102260044B1 (ko) * 2018-11-09 2021-06-03 한국과학기술원 카메라 캘리브레이션 방법 및 장치
CN109981981B (zh) * 2019-03-14 2021-04-06 广州市红鹏直升机遥感科技有限公司 航拍设备的工作模式切换方法及装置
CN111726536B (zh) * 2020-07-03 2024-01-05 腾讯科技（深圳）有限公司 视频生成方法、装置、存储介质及计算机设备

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130176423A1 (en) * 2012-01-05 2013-07-11 Parrot Method for piloting a rotary wing drone for taking an exposure through an onboard camera with minimization of the disturbing movements
EP2778819A1 (fr) * 2013-03-12 2014-09-17 Thomson Licensing Procédé de prise de vue d'une interprétation cinématographique utilisant un véhicule aérien sans pilote

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2514441T3 (es) * 2003-10-13 2014-10-28 Saab Ab Procedimiento de planificación de una trayectoria
US9513125B2 (en) * 2008-01-14 2016-12-06 The Boeing Company Computing route plans for routing around obstacles having spatial and temporal dimensions
US8082102B2 (en) * 2008-01-14 2011-12-20 The Boeing Company Computing flight plans for UAVs while routing around obstacles having spatial and temporal dimensions
US8676406B2 (en) * 2011-05-03 2014-03-18 Raytheon Company Unmanned aerial vehicle control using a gamepad
US20150350614A1 (en) * 2012-08-31 2015-12-03 Brain Corporation Apparatus and methods for tracking using aerial video
US10067510B2 (en) * 2014-02-14 2018-09-04 Accenture Global Services Limited Unmanned vehicle (UV) movement and data control system
WO2015180133A1 (fr) * 2014-05-30 2015-12-03 深圳市大疆创新科技有限公司 Procédé et système pour générer le cap d'un véhicule aérien sans pilote
US9678506B2 (en) * 2014-06-19 2017-06-13 Skydio, Inc. Magic wand interface and other user interaction paradigms for a flying digital assistant
US9798324B2 (en) * 2014-07-18 2017-10-24 Helico Aerospace Industries Sia Autonomous vehicle operation

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130176423A1 (en) * 2012-01-05 2013-07-11 Parrot Method for piloting a rotary wing drone for taking an exposure through an onboard camera with minimization of the disturbing movements
EP2778819A1 (fr) * 2013-03-12 2014-09-17 Thomson Licensing Procédé de prise de vue d'une interprétation cinématographique utilisant un véhicule aérien sans pilote

Also Published As

Publication number Publication date
JP2016095841A (ja) 2016-05-26
US20160117811A1 (en) 2016-04-28
EP3015146A1 (fr) 2016-05-04
CN105549612A (zh) 2016-05-04
KR20160049986A (ko) 2016-05-10

Similar Documents

Publication Publication Date Title
EP3015147A1 (fr) Procédé permettant de générer une trajectoire cible d'une caméra embarquée sur un drone et système correspondant
US11869234B2 (en) Subject tracking systems for a movable imaging system
US10636150B2 (en) Subject tracking systems for a movable imaging system
US20230045393A1 (en) Volumetric depth video recording and playback
CN105391939B (zh) 无人机拍摄控制方法和装置、无人机拍摄方法和无人机
US9479703B2 (en) Automatic object viewing methods and apparatus
US20140267777A1 (en) Method for shooting a performance using an unmanned aerial vehicle
CN109071034A (zh) 切换云台工作模式的方法、控制器和图像增稳设备
US20170046865A1 (en) Animation motion capture using three-dimensional scanner data
US20100253676A1 (en) Simulating performance of virtual camera
CN110254734A (zh) 使用稳定用常平架的常平架系统
US20220067968A1 (en) Motion capture calibration using drones with multiple cameras
US20170039671A1 (en) Robotic self-filming system
US9242379B1 (en) Methods, systems, and computer readable media for producing realistic camera motion for stop motion animation
EP2849150A1 (fr) Procédé permettant de capturer le mouvement tridimensionnel d'un objet, véhicule aérien sans pilote et système de capture de mouvement
WO2019127052A1 (fr) Procédé de répétition de trajectoire de vol et véhicule aérien
US9870637B2 (en) Frame removal and replacement for stop-action animation
CN108364336A (zh) 基于三维动画动作捕捉虚拟摄像机防抖的方法和系统
CN116940966A (zh) 指示虚拟位置的真实世界信标
JP2010183384A (ja) 撮影カメラ学習装置及びそのプログラム
US20230359204A1 (en) Flight control method, video editing method, device, uav and storage medium
US11600022B2 (en) Motion capture calibration using drones
US11636621B2 (en) Motion capture calibration using cameras and drones
US11948257B2 (en) Systems and methods for augmented reality video generation
US11178355B2 (en) System and method for generating visual animation

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20161104

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

R17P Request for examination filed (corrected)

Effective date: 20161104

18W Application withdrawn

Effective date: 20161222