EP3481719A1 - Vehicle-integrated drone - Google Patents
Vehicle-integrated droneInfo
- Publication number
- EP3481719A1 EP3481719A1 EP16908310.2A EP16908310A EP3481719A1 EP 3481719 A1 EP3481719 A1 EP 3481719A1 EP 16908310 A EP16908310 A EP 16908310A EP 3481719 A1 EP3481719 A1 EP 3481719A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- host vehicle
- drone
- commanding
- vehicle
- alert signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/90—Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/02—Arrangements or adaptations of signal or lighting devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/02—Arrangements or adaptations of signal or lighting devices
- B64D47/04—Arrangements or adaptations of signal or lighting devices the lighting devices being primarily intended to illuminate the way ahead
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/02—Arrangements or adaptations of signal or lighting devices
- B64D47/06—Arrangements or adaptations of signal or lighting devices for indicating aircraft presence
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U70/00—Launching, take-off or landing arrangements
- B64U70/90—Launching from or landing on platforms
- B64U70/92—Portable platforms
- B64U70/93—Portable platforms for use on a land or nautical vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U80/00—Transport or storage specially adapted for UAVs
- B64U80/80—Transport or storage specially adapted for UAVs by vehicles
- B64U80/86—Land vehicles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W4/44—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/20—UAVs specially adapted for particular uses or applications for use as communications relays, e.g. high-altitude platforms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
Definitions
- Stranded vehicles are often moved to the side of the road so that they do not impede traffic.
- the stranded vehicle can be towed to a service station or possibly repaired and driven away. Sometimes, the stranded vehicle is left unoccupied and unattended on the side of the road.
- FIGS. 1A and IB illustrate an example vehicle having a deployable drone
- FIG. 2 is a block diagram showing example components of the drone deployment system.
- FIG. 3 is a flowchart of an example process that may be executed by the drone deployment system to deploy the drone.
- Stranded vehicles can sometimes be hard to find.
- the driver of a service truck (such as a tow truck) may not know what side of the road the stranded vehicle is parked or may not be able to see the stranded vehicle at night or if visibility is low.
- the same issues arise if the occupant of the vehicle requires emergency services.
- the emergency service personnel (police officer, fireman, emergency medical technician, etc.) may have difficulty finding the stranded vehicle.
- a drone that deploys from, and draws attention to, the vehicle.
- the drone may hover above the vehicle and shine a light onto the vehicle, turn on a siren, or provide any other type of perceptible alert.
- the deployment of the drone may be handled by a drone deployment system having a processor programmed to receive an alert signal, deploy the drone from the vehicle in response to receiving the alert signal, and command the drone to follow the host vehicle and to present the perceptible alert.
- the drone will draw attention to the host vehicle, making the host vehicle easier for the driver of the service truck or the emergency service personnel to find.
- the elements shown may take many different forms and include multiple and/ or alternate components and facilities.
- the example components illustrated are not intended to be limiting. Indeed, additional or alternative components and/ or implementations may be used.
- a host vehicle 100 includes a deployable drone 105 and a drone deployment system 110. Although illustrated as a sedan, the host vehicle 100 may include any passenger or commercial automobile such truck, a sport utility vehicle, a crossover vehicle, a van, a minivan, a taxi, a bus, etc. In some possible approaches, the host vehicle 100 is an autonomous vehicle that can operate in an autonomous (e.g., driverless) mode, a partially autonomous mode, and/ or a non-autonomous mode.
- an autonomous e.g., driverless
- the deployable drone 105 is an unmanned aerial vehicle and includes a number of circuits, chips, or other electronic components that can control various operations of the deployable drone 105. For instance, the deployable drone 105 may fly in accordance with control signals output to its propellers. The deployable drone 105 may be outfitted with a navigation system 140 so that it can fly to, and hover at, a particular location. Moreover, the deployable drone 105 may be outfitted with various alert devices such as lights 120, sirens, or both. In some possible approaches, the deployable drone 105 may include one or more cameras that can capture images of an area near the drone.
- the cameras may be located in the same housing as the lights 120, and the deployable drone 105 may be programmed to turn on the camera to capture images of an area below the deployable drone 105.
- the camera may capture images of the host vehicle 100 and possibly the area around the host vehicle 100, depending on how far above the host vehicle 100 the deployable drone 105 is hovering.
- the deployable drone 105 may be programmed to operate in different modes.
- Example modes may include a panic mode, a security mode, a static view mode, a monitoring mode, and a fly mode.
- the deployable drone 105 may be programmed to hover above the host vehicle 100 while both shining the light 120 onto the host vehicle 100 and its surrounding area and also emitting an audible alert through the siren or a speaker.
- the deployable drone 105 may be programmed to hover above the host vehicle 100 and shine the light 120 onto the host vehicle 100 and its surrounding area.
- the static view mode the deployable drone 105 may be programmed to hover over the host vehicle 100 with the camera turned on to capture images of the host vehicle 100 and its surrounding area.
- the deployable drone 105 may be further programmed to stream the video captured by the camera to a user's mobile device.
- the deployable drone 105 may be programmed to hover over the host vehicle 100 with the camera turned on and pointed toward an object of interest (which may or may not be the host vehicle 100).
- the deployable drone 105 may broadcast the video captured by the camera to nearby mobile devices or make the video otherwise accessible to a group of mobile devices beyond that of the owner of the host vehicle 100.
- operating in the monitoring mode may include the deployable drone 105 presenting a live stream of the video captured by the camera to anyone with permission to view the live stream.
- the deployable drone 105 When operating in the fly mode, the deployable drone 105 may be programmed to fly to a particular location, at the direction of a user input, and capture images via the camera.
- the user input may be provided via a user interface (see FIG. 2) located in the host vehicle 100, via a mobile device, or the like.
- the drone deployment system 110 is implemented via circuits, chips, or other electronic components that can receive an alert signal from a remote server 115, deploy the deployable drone 105 from the host vehicle 100 in response to receiving the alert signal, and command the drone to follow the host vehicle 100, present a perceptible alert, or both.
- the drone deployment system 110 may wirelessly communicate with the remote server 115 via any number of telecommunications protocols.
- the communication between the drone deployment system 110 and the remote server 115 may be in accordance with cellular or satellite communication protocols, including 3G, 4G, LTE, etc.
- the drone deployment system 110 may output a control signal to an actuator that, in response to the control signal, opens a door, such as a trunk, of the host vehicle 100 (see FIG. 1A).
- the same or different control signal may be provided to actuators that release the deployable drone 105 from any number of in-vehicle locks that otherwise secure the deployable drone 105 when it is not in use.
- the commands output to the deployable drone 105 may include a command for the deployable drone 105 to exit the host vehicle 100 (i.e., fly out of the trunk) and hover above the host vehicle 100 (see FIG. IB).
- the commands may include a command for the deployable drone 105 to follow the host vehicle 100 if, e.g., the host vehicle 100 is moving.
- Additional commands may include commanding the deployable drone 105 to present a perceptible alert (shining a light 120 in a particular area, turning on the siren, etc.) or commanding the deployable drone 105 to operate in one of the modes discussed above.
- one of the commands output to the deployable drone 105 may cause the deployable drone 105 to operate in the panic mode, the security mode, the static view mode, the monitoring mode, or the fly mode.
- the drone deployment system 110 may select the operating mode of the deployable drone 105 according to any number of factors including, e.g., the alert signal. For instance, if the alert signal indicates the vehicle owner's desire for the deployable drone 105 to operate in the panic mode, the drone deployment system 110 may select that mode. Since operating in the panic mode includes the deployable drone 105 shining the light 120 and turning on the siren, the selection of the perceptible alert is in accordance with the selected operating mode.
- the drone deployment system 110 receives the alert signal from a remote server 115.
- the remote server 115 may initiate the alert signal in response to a user input, which could include a user input from the owner of the host vehicle 100.
- the user input may be provided by the owner of the host vehicle 100 to his or her mobile device, computer, etc., and transmitted to the remote server 115 via a wireless communication protocol, including cellular communication protocols, satellite communication protocols, or the like.
- the user input may be transmitted to the remote server 115 through a wired communication interface if, e.g., the user input is provided to a desktop or laptop computer that at least partially relies on a wired network connection to communicate with remote computing devices.
- the user input may be received via an in-vehicle user interface such as an infotainment system touchscreen incorporated into the host vehicle 100.
- the alert signal may be transmitted from the infotainment system to the processor without an intervening remote server 115.
- the alert signal may be transmitted in response to a
- the emergency service provider may be associated with a police station, fire station, hospital, ambulance service, vehicle service center, etc.
- the emergency service provider may communicate with the remote server 115 to instruct the remote server 115 to transmit the alert signal to the host vehicle 100, and specifically, to the drone deployment system 110.
- the drone deployment system 110 may be programmed to only permit certain modes of operation of the deployable drone 105 based on the origination of the alert signal. For instance, the drone deployment system 110 may permit any operating mode following receipt of the alert signal generated in response to a user input generated by the owner or user of the host vehicle 100. The drone deployment system 110 may, however, only permit the panic mode, the security mode, or the static view mode when the alert signal is generated in response to a communication from the emergency service provide to the remote server 115. In other words, the emergency service provider may not be permitted to transmit an alert signal that will deploy the deployable drone 105 and cause the deployable drone 105 to operate in the monitoring mode or the fly mode.
- FIG. 1A illustrates the deployable drone 105 located in the trunk of the host vehicle 100.
- FIG. IB illustrates the deployable drone 105 hovering over the host vehicle 100. Also, as shown in FIG. IB, the light 120 of the deployable drone 105 is illuminated and the siren is turned on (shown by the sound waves 125).
- the drone deployment system 110 includes or otherwise works in accordance with a communication interface 130, a user interface 135, a navigation system 140, deployment actuators 145, a memory 150, and a processor 155. These and possibly other components of the drone deployment system 110 or the host vehicle 100 are in communication with one another via a communication network 160, such as a controller area network (CAN) bus, Ethernet, Bluetooth®, Bluetooth Low Energy®, WiFi, or the like.
- a communication network 160 such as a controller area network (CAN) bus, Ethernet, Bluetooth®, Bluetooth Low Energy®, WiFi, or the like.
- the communication interface 130 is implemented via circuits, chips, or other electronic components that can facilitate wired or wireless communication with remote devices such as the remote server 115, a user's mobile device, the deployable drone 105, etc.
- the communication interface 130 may be programmed to communicate in accordance with any number of
- the communication interface 130 may be programmed to transmit messages to, and receive messages from, the remote server 115, a mobile device, etc.
- the communication interface 130 may be further programmed to forward received messages to, e.g., the memory 150 or the processor 155. Further, the communication interface 130 may generate and transmit messages in accordance with instructions received from the processor 155 or other components of the host vehicle 100, such as the navigation system 140.
- the communication interface 130 may also be programmed to transmit messages to the deployable drone 105.
- the messages transmitted to the deployable drone 105 may include instructions from the processor 155, the location of the host vehicle 100 from the navigation system 140, etc.
- the user interface 135 is implemented via circuits, chips, or other electronic components that can receive user inputs provided by an occupant of the host vehicle 100.
- the user interface 135 may include a display screen for presenting information to the user and for prompting the user to provide various user inputs.
- the user interface 135 may further include buttons for receiving user inputs.
- the user interface 135 includes a touch-sensitive display screen that can present information to the occupant, prompt the occupant for information, and receive user inputs resulting from the occupant touching designated areas (virtual buttons or soft keys) of the touch-sensitive display screen.
- the user interface 135 may be programmed to output signals representing the user inputs received.
- the user interface 135 may be incorporated into, e.g., a vehicle infotainment system.
- the navigation system 140 is implemented via circuits, chips, or other electronic components that can determine the location of the host vehicle 100 and output signals representing the location of the host vehicle 100.
- the navigation system 140 may be programmed to determine the location of the host vehicle 100 in accordance with signals received from a satellite system, such as the Global Positioning System (GPS).
- GPS Global Positioning System
- the navigation system 140 may be further programmed to receive, from the user interface 135, a destination and develop a route from the present location of the host vehicle 100 to the destination. In some instances, the navigation system 140 may be programmed to transmit a signal representing the location of the host vehicle 100 to the GPS.
- GPS Global Positioning System
- the communication interface 130 with an instruction to transmit the location to, e.g., the deployable drone 105, the remote server 115, the mobile device, etc.
- the deployment actuators 145 are implemented via solenoids or other types of electromechanical devices that convert electric signals into motion.
- One or more deployment actuators 145 may be used to lock the deployable drone 105 in or to the host vehicle 100 when the deployable drone 105 is not in use. That is, those deployment actuators 145 may be in a locked state while the deployable drone 105 is stored in, e.g., the trunk of the host vehicle 100, and may transition to an unlocked state in response to receiving a control signal output by, e.g., the processor 155.
- the same or different deployment actuators 145 may be used to release the trunk or other door that allows the deployable drone 105 to exit the host vehicle 100.
- the deployment actuators 145 may transition to the unlocked state so the deployable drone 105 can be released from, e.g., the trunk and hover above the host vehicle 100.
- the memory 150 is implemented via circuits, chips, or other electronic components that can electronically store data.
- the memory 150 may store instructions executable by the
- the memory 150 may further store data received from any component in the host vehicle 100 and make stored data available to the components of the host vehicle 100.
- the processor 155 is implemented via circuits, chips, or other electronic components that can control various operations of the drone deployment system 110.
- the processor 155 may be programmed to receive the alert signal.
- the processor 155 may receive the alert signal via the user interface 135 or the communication interface 130.
- the processor 155 may receive the alert signal via the user interface 135 after the alert signal is generated in response to a user input provided to the user interface 135.
- the processor 155 may receive the alert signal via the communication interface 130 after the alert signal is generated in response to a user input provided to a mobile device or generated by the remote server 115 and wirelessly transmitted to the host vehicle 100.
- the processor 155 may be further programmed to output signals to deploy the drone from the host vehicle 100.
- the signals may be generated and output by the processor 155 in response receiving and processing the alert signal.
- Deploying the drone from the host vehicle 100 may include the processor 155 outputting control signals to the deployment actuators 145 to switch the deployment actuators 145 from the locked state to the unlocked state. In doing so, the deployable drone 105 may be released from, e.g., the trunk of the host vehicle 100.
- the processor 155 may be programmed to transmit various command signals to the deployable drone 105.
- the processor 155 may transmit the commands to the deployable drone 105 by instructing the communication interface 130 to create a message with the command and wirelessly transmit the message with the command to the deployable drone 105.
- the processor 155 may be programmed to generate and transmit any number of command signals.
- the command signals may instruct the deployable drone 105 to operate in one or more of the modes discussed above.
- the processor 155 may be programmed to select an operating mode in accordance with the alert signal.
- the processor 155 may be programmed to select the panic mode as the operating mode and output commands to the deployable drone 105 that instruct the deployable drone 105 to operate in the panic mode.
- the commands to operate in the selected mode may further include commands for the deployable drone 105 to present various perceptible alerts associated with the selected operating mode, the user input, etc.
- the processor 155 may output command signals instructing the deployable drone 105 to hover above the host vehicle 100, shine a light 120 toward the host vehicle 100, and turn on the siren.
- Other perceptible alerts, or groups of perceptible alerts may be associated with other operating modes. For instance, shining the light 120 onto the host vehicle 100 (but not turning on the siren) is associated with the security mode. Some operating modes do not include any perceptible alerts.
- the processor 155 may be programmed to output commands instructing the deployable drone 105 to present the perceptible alert independent of any particular operating mode. That is, the processor 155 may be programmed to instruct the deployable drone 105 to shine the light 120 on the host vehicle 100, turn on the siren, etc., in response to receiving an alert signal requesting as much.
- the command signals may include commands for the deployable drone 105 to follow the host vehicle 100 (i.e., follow commands).
- the follow commands may include the processor 155 instructing the navigation system 140 to periodically determine the location of the host vehicle 100 and instructing the communication interface 130 to periodically (e.g., each time the location of the host vehicle 100 is determined by the navigation system 140) transmit the location of the host vehicle 100 to the deployable drone 105.
- the follow commands may further include commanding the communication interface 130 to transmit instructions to the deployable drone 105 to follow the host vehicle 100 according to the location determined by the navigation system 140.
- the processor 155 may be further programmed to command the communication interface 130 to send messages to the remote server 115 associated with the emergency service provider. For instance, in response to receiving an alert signal requesting the deployable drone 105 to operate in the panic mode or the security mode, the processor 155 may command the communication interface 130 to transmit the location of the host vehicle 100, as determined by the navigation system 140, to the remote server 115.
- the emergency service provider may be able to dispatch an emergency vehicle to the location of the host vehicle 100.
- the driver of the emergency vehicle will be able to easily identify the host vehicle 100 with the drone hovering over the host vehicle 100, shining a light 120 on the host vehicle 100, and possibly blaring the siren.
- FIG. 3 is a flowchart of an example process 300 that may be executed by the drone deployment system 110 to deploy the drone from the host vehicle 100 and output various signals to control the drone.
- the drone deployment system 110 receives an alert signal.
- the alert signal may be received at the host vehicle 100 by the communication interface 130 and forwarded to the processor 155 or transmitted from, e.g., an in-vehicle infotainment system to the processor 155 without an intervening remote server 115.
- the alert signal as discussed above, may be generated in response to a user input, which could include a user input from the owner of the host vehicle 100 or from an emergency service provider.
- the drone deployment system 110 may select an operating mode of the deployable drone 105.
- Example modes may include the panic mode, the security mode, the static view mode, the monitoring mode, and the fly mode, all of which are discussed above.
- the processor 155 may select the operating mode in accordance with the alert signal. For instance, if the alert signal indicates the vehicle owner's desire for the deployable drone 105 to operate in the panic mode, the drone deployment system 110 may select that mode.
- the drone deployment system 110 may select the perceptible alert. Some perceptible alerts are associated with particular modes. Therefore, the processor 155 may select the perceptible alert according to the operating mode selected at block 310. For instance, if the panic mode is selected at block 310, the processor 155 may select shining the light 120 and turning on the siren as two perceptible alerts since those two alerts as associated with the panic mode.
- the drone deployment system 110 may deploy the deployable drone 105.
- the processor 155 may output signals to the deployment actuators 145, the trunk, or both, to release the deployable drone 105 and allow the deployable drone 105 to fly out of the host vehicle 100.
- the drone deployment system 110 may command the deployable drone 105 to operate in the mode selected at block 310 and to present the perceptible alert selected at block 315.
- the processor 155 may command the communication interface 130 to transmit the command signals to the deployable drone 105 either before or after the drone is freed from the host vehicle 100 at block 320.
- block 325 may occur simultaneously with block 320. That is, the command signals instructing the deployable drone 105 to leave the host vehicle 100 may also serve as the command signals for the deployable drone 105 to operate in a particular operating mode, present particular perceptible alerts, or both.
- the drone deployment system 110 may determine whether the deployable drone 105 should follow the host vehicle 100.
- the processor 155 may make this decision based on the operating mode selected at block 310. For instance, if the monitoring mode is selected at block 310, the processor 155 may determine that the deployable drone 105 should follow the host vehicle 100. Alternatively, the decision for the deployable drone 105 to follow the host vehicle 100 may be based on a request from an emergency service provider received via the remote server 115. If the processor 155 determines that the deployable drone 105 should follow the host vehicle 100, the process 300 may proceed to block 335. Otherwise, the process 300 may proceed to block 355.
- the drone deployment system 110 may command the drone to follow the host vehicle 100.
- Commanding the drone to follow the host vehicle 100 may include the processor 155 transmitting a follow command to the deployable drone 105.
- the follow command may instruct the deployable drone 105 to navigate to locations that will be provided by the processor 155 via, e.g., the communication interface 130.
- the follow command may be transmitted at block 320 with the signals commanding the deployable drone 105 to operate in a particular operating mode, as discussed above.
- the drone deployment system 110 may determine the location of the host vehicle 100.
- the processor 155 may determine the location of the host vehicle 100 from, e.g., the navigation system 140.
- the location of the host vehicle 100 may be determined periodically.
- block 340 may be executed multiple times during the process 300.
- the location of the host vehicle 100 may be determined every time block 340 is executed.
- the drone deployment system 110 may transmit the location of the host vehicle 100 to the deployable drone 105, the remote server 115, or both.
- the processor 155 may command the communication interface 130 to transmit the location of the host vehicle 100 to the deployable drone 105, the remote server 115, or both each time a new location of the host vehicle 100 is determined at block 340.
- the location of the host vehicle 100 may be transmitted to the deployable drone 105 when the deployable drone 105 is operating in the monitoring mode.
- the location of the host vehicle 100 may be transmitted to the remote server 115 in response to a request, included in the alert signal, from the emergency service provider.
- the drone deployment system 110 may determine whether to continue the follow mode. That is, the processor 155 may determine whether to continue the follow mode based on a user input requesting a different operating mode (e.g., an operating mode other than the monitoring mode), a signal from the remote server 115 indicating that the emergency service provider no longer needs the drone to operate in the follow mode, or the like. If the processor 155 determines to continue with the follow mode, the process 300 may proceed to block 340 so that the present location of the host vehicle 100 can be determined and transmitted to the deployable drone 105, the remote server 115, or both. If the processor 155 decides to cease the follow mode, the process 300 may proceed to decision block 355.
- a different operating mode e.g., an operating mode other than the monitoring mode
- the drone deployment system 110 may determine whether the process 300 should end. For instance, the processor 155 may determine whether additional use of the deployable drone 105 is desired from the owner of the host vehicle 100 or the emergency service provider. This may include receiving a new alert, selecting a new operating mode, selecting a new perceptible alert, etc., before proceeding to block 325. If additional use of the deployable drone 105 is needed, the process 300 may proceed to block 325 so that the deployable drone 105 may be commanded to operate in a particular operating mode, present a particular perceptible alert, or both. If additional use of the deployable drone 105 is not desired, the process 300 may end after block 355.
- the deployable drone 105 may hover above the host vehicle 100 and shine a light 120 onto the host vehicle 100, turn on a siren, or provide any other type of perceptible alert.
- the drone will draw attention to the host vehicle 100, making the host vehicle 100 easier for emergency service personnel or, e.g., a tow truck driver, to find.
- the computing systems and/ or devices described may employ any of a number of computer operating systems, including, but by no means limited to, versions and/ or varieties of the Ford Sync® application, AppLink/Smart Device Link middleware, the Microsoft Automotive® operating system, the Microsoft Windows® operating system, the Unix operating system (e.g., the Solaris® operating system distributed by Oracle Corporation of Redwood Shores, California), the AIX UNIX operating system distributed by International Business Machines of Armonk, New York, the Linux operating system, the Mac OSX and iOS operating systems distributed by Apple Inc. of Cupertino, California, the BlackBerry OS distributed by Blackberry, Ltd. of Waterloo, Canada, and the Android operating system developed by Google, Inc. and the Open Handset Alliance, or the QNX® CAR Platform for Infotainment offered by QNX Software Systems.
- the Unix operating system e.g., the Solaris® operating system distributed by Oracle Corporation of Redwood Shores, California
- the AIX UNIX operating system distributed by International Business Machines of Armonk, New
- Examples of computing devices include, without limitation, an on-board vehicle computer, a computer workstation, a server, a desktop, notebook, laptop, or handheld computer, or some other computing system and/ or device.
- Computing devices generally include computer-executable instructions, where the instructions may be executable by one or more computing devices such as those listed above.
- Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and/ or technologies, including, without limitation, and either alone or in combination, JavaTM, C, C++, Visual Basic, Java Script, Perl, etc. Some of these applications may be compiled and executed on a virtual machine, such as the Java Virtual Machine, the Dalvik virtual machine, or the like.
- a processor e.g., a microprocessor
- receives instructions e.g., from a memory 150, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein.
- Such instructions and other data may be stored and transmitted using a variety of computer-readable media.
- a computer-readable medium includes any non-transitory (e.g., tangible) medium that participates in providing data (e.g., instructions) that may be read by a computer (e.g., by a processor of a computer).
- a medium may take many forms, including, but not limited to, non-volatile media and volatile media.
- Non-volatile media may include, for example, optical or magnetic disks and other persistent memory.
- Volatile media may include, for example, dynamic random access memory (DRAM), which typically constitutes a main memory.
- DRAM dynamic random access memory
- Such instructions may be transmitted by one or more transmission media, including coaxial cables, copper wire and fiber optics, including the wires that comprise a system bus coupled to a processor of a computer.
- Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- Databases, data repositories or other data stores described herein may include various kinds of mechanisms for storing, accessing, and retrieving various kinds of data, including a hierarchical database, a set of files in a file system, an application database in a proprietary format, a relational database management system (RDBMS), etc.
- Each such data store is generally included within a computing device employing a computer operating system such as one of those mentioned above, and are accessed via a network in any one or more of a variety of manners.
- a file system may be accessible from a computer operating system, and may include files stored in various formats.
- An RDBMS generally employs the Structured Query Language (SQL) in addition to a language for creating, storing, editing, and executing stored procedures, such as the PL/SQL language mentioned above.
- SQL Structured Query Language
- system elements may be implemented as computer-readable instructions (e.g., software) on one or more computing devices (e.g., servers, personal computers, etc.), stored on computer readable media associated therewith (e.g., disks, memories, etc.).
- a computer program product may comprise such instructions stored on computer readable media for carrying out the functions described herein.
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Environmental & Geological Engineering (AREA)
- Public Health (AREA)
- Transportation (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/US2016/041230 WO2018009190A1 (en) | 2016-07-07 | 2016-07-07 | Vehicle-integrated drone |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP3481719A1 true EP3481719A1 (en) | 2019-05-15 |
| EP3481719A4 EP3481719A4 (en) | 2020-03-11 |
| EP3481719B1 EP3481719B1 (en) | 2023-11-29 |
Family
ID=60913029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP16908310.2A Active EP3481719B1 (en) | 2016-07-07 | 2016-07-07 | Vehicle-integrated drone |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11006263B2 (en) |
| EP (1) | EP3481719B1 (en) |
| CN (1) | CN109641659B (en) |
| WO (1) | WO2018009190A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9994313B2 (en) | 2014-11-26 | 2018-06-12 | XCraft Enterprises, LLC | High speed multi-rotor vertical takeoff and landing aircraft |
| WO2018094628A1 (en) * | 2016-11-23 | 2018-05-31 | 深圳市大疆创新科技有限公司 | Method for controlling unmanned aerial vehicle, server and remote controller |
| US10755582B2 (en) * | 2017-12-28 | 2020-08-25 | Paypal, Inc. | Drone physical and data interface for enhanced distance coverage |
| WO2020013525A1 (en) * | 2018-07-11 | 2020-01-16 | Samsung Electronics Co., Ltd. | In-vehicle infotainment system communicating with unmanned aerial vehicle and method of operating the same |
| JP7153194B2 (en) * | 2018-12-17 | 2022-10-14 | トヨタ自動車株式会社 | Remote monitoring system and monitoring server |
| GB2580908A (en) * | 2019-01-28 | 2020-08-05 | Kompetenzzentrum Das Virtuelle Fahrzeung Forschungsgesellschaft Mbh | Method and device for selective active and passive sensing in automated driving applications |
| US11221626B2 (en) | 2019-04-23 | 2022-01-11 | HERE Global, B.V. | Drone-based collection of location-related data |
| KR102740147B1 (en) | 2019-06-24 | 2024-12-06 | 현대자동차주식회사 | Method And Apparatus for using an UAV in a vehicle |
| CN114007910B (en) | 2019-06-26 | 2023-06-23 | 沃尔沃卡车集团 | A method of providing assistance to a vehicle |
| US11488395B2 (en) | 2019-10-01 | 2022-11-01 | Toyota Research Institute, Inc. | Systems and methods for vehicular navigation |
| CN113359724B (en) * | 2021-06-02 | 2023-02-24 | 岚图汽车科技有限公司 | Vehicle intelligent driving system and method based on unmanned aerial vehicle and storage medium |
| CN113873725B (en) * | 2021-09-10 | 2023-10-31 | 广州小鹏汽车科技有限公司 | Linkage control method between flight equipment and vehicle lighting components, vehicle and flight equipment |
| US12441187B2 (en) * | 2022-11-18 | 2025-10-14 | Rivian Ip Holdings, Llc | Vehicle spotter drone |
| GB2626344A (en) * | 2023-01-18 | 2024-07-24 | Bentley Motors Ltd | Vehicle based drone |
| US20250004468A1 (en) * | 2023-06-30 | 2025-01-02 | Fca Us Llc | Method to control a vehicle as a function of data from a vehicle-based drone |
| MX2024010921A (en) * | 2023-09-11 | 2025-04-02 | Polaris Inc | Drone integration with the vehicle. |
| US12480779B2 (en) | 2023-10-15 | 2025-11-25 | Ford Global Technologies, Llc | Unmanned aerial vehicle for course marking |
| US20260016825A1 (en) * | 2024-07-12 | 2026-01-15 | Toyota Motor Engineering & Manufacturing North America, Inc. | Systems and methods for vehicle pose-based unmanned aerial vehicle control |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9873442B2 (en) | 2002-06-04 | 2018-01-23 | General Electric Company | Aerial camera system and method for identifying route-related hazards |
| US8115608B2 (en) * | 2003-09-16 | 2012-02-14 | Qualcomm Incorporated | Method and apparatus for providing a hazardous material alert |
| JP2006180326A (en) | 2004-12-24 | 2006-07-06 | Equos Research Co Ltd | Vehicle status monitoring system |
| US9094816B2 (en) * | 2006-05-16 | 2015-07-28 | RedSky Technologies, Inc. | Method and system for an emergency location information service (E-LIS) from unmanned aerial vehicles (UAV) |
| WO2008085536A2 (en) | 2006-05-23 | 2008-07-17 | Avid, Llc | Dual-use modular propulsion surveillance vehicle with detachable unmanned airborne vehicles |
| US8028952B2 (en) * | 2008-03-31 | 2011-10-04 | The Boeing Company | System for shipboard launch and recovery of unmanned aerial vehicle (UAV) aircraft and method therefor |
| US8434920B2 (en) * | 2010-08-17 | 2013-05-07 | Kenneth R Jones | Aerially deployed illumination system |
| DE102011106170A1 (en) | 2011-07-01 | 2012-02-02 | Daimler Ag | Method for assisting driver while controlling vehicle, involves detecting surrounding of vehicle by image detection device that is arranged in air craft movable independent from vehicle |
| FR2986647A3 (en) * | 2012-02-07 | 2013-08-09 | Renault Sas | MOTOR VEHICLE ASSOCIATED WITH AN OBSERVATION DRONE |
| US20150321758A1 (en) * | 2013-08-31 | 2015-11-12 | II Peter Christopher Sarna | UAV deployment and control system |
| US9158304B2 (en) * | 2013-11-10 | 2015-10-13 | Google Inc. | Methods and systems for alerting and aiding an emergency situation |
| EP3786742B1 (en) | 2014-05-30 | 2025-02-19 | SZ DJI Technology Co., Ltd. | Systems and methods for uav docking |
| US9409644B2 (en) | 2014-07-16 | 2016-08-09 | Ford Global Technologies, Llc | Automotive drone deployment system |
| US20160042637A1 (en) * | 2014-08-11 | 2016-02-11 | Clandestine Development, Llc | Drone Safety Alert Monitoring System and Method |
| CN204415730U (en) | 2015-01-29 | 2015-06-24 | 马鞍山市赛迪智能科技有限公司 | A kind of mobile formula unmanned vehicle base station of leaving a blank |
| US20170253330A1 (en) * | 2016-03-04 | 2017-09-07 | Michael Saigh | Uav policing, enforcement and deployment system |
-
2016
- 2016-07-07 EP EP16908310.2A patent/EP3481719B1/en active Active
- 2016-07-07 US US16/315,314 patent/US11006263B2/en active Active
- 2016-07-07 WO PCT/US2016/041230 patent/WO2018009190A1/en not_active Ceased
- 2016-07-07 CN CN201680088558.7A patent/CN109641659B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018009190A1 (en) | 2018-01-11 |
| CN109641659B (en) | 2023-01-24 |
| US20190313228A1 (en) | 2019-10-10 |
| EP3481719B1 (en) | 2023-11-29 |
| US11006263B2 (en) | 2021-05-11 |
| EP3481719A4 (en) | 2020-03-11 |
| CN109641659A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11006263B2 (en) | Vehicle-integrated drone | |
| US9921581B2 (en) | Autonomous vehicle emergency operating mode | |
| CN107526311B (en) | System and method for detection of objects on exterior surface of vehicle | |
| KR102379392B1 (en) | Multiple driving modes for autonomous vehicles | |
| US10068485B2 (en) | Platooning autonomous vehicle navigation sensory exchange | |
| US9529361B2 (en) | Apparatus and method for managing failure in autonomous navigation system | |
| US10499233B2 (en) | Dynamic vehicle disaster relief | |
| US10775509B2 (en) | Sensor field of view mapping | |
| DE112017007427T5 (en) | PREVENTING A LOST OBJECT IN A VEHICLE | |
| US20210229655A1 (en) | Systems and methods for executing automated vehicle maneuvering operations | |
| US11577726B2 (en) | Vehicle assist feature control | |
| US11738774B2 (en) | Roadside assistance for autonomous vehicles | |
| CN109155103B (en) | Real-time communication with mobile infrastructure | |
| US11926348B2 (en) | Method and device for controlling applications distributed between a vehicle and a cloud | |
| US20220144294A1 (en) | Vehicle feature availability detection | |
| US10234869B2 (en) | Vehicle destinations | |
| US20230145286A1 (en) | Vehicle management system, server, vehicle, and vehicle management method | |
| US11037449B2 (en) | Autonomous bus silent alarm | |
| CN110998534A (en) | Role-based dynamic update of HMI context | |
| US12455565B2 (en) | Emergency vehicle interactions using external triggers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20190205 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20200210 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: B64C 39/02 20060101AFI20200204BHEP |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20210602 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20230623 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230620 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016084478 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240301 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240329 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240329 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240301 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240229 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1635882 Country of ref document: AT Kind code of ref document: T Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240229 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240401 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240401 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016084478 Country of ref document: DE |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| 26N | No opposition filed |
Effective date: 20240830 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240707 |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20240707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240731 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240707 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20240731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231129 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20250616 Year of fee payment: 10 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160707 |