WO2013002778A1 - 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays - Google Patents

3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays Download PDF

Info

Publication number
WO2013002778A1
WO2013002778A1 PCT/US2011/042297 US2011042297W WO2013002778A1 WO 2013002778 A1 WO2013002778 A1 WO 2013002778A1 US 2011042297 W US2011042297 W US 2011042297W WO 2013002778 A1 WO2013002778 A1 WO 2013002778A1
Authority
WO
WIPO (PCT)
Prior art keywords
luminous
pixel array
flying
flying vehicles
vehicle
Prior art date
Application number
PCT/US2011/042297
Other languages
French (fr)
Inventor
Carlo Ratti
Original Assignee
Massachusetts Institute Of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Massachusetts Institute Of Technology filed Critical Massachusetts Institute Of Technology
Priority to PCT/US2011/042297 priority Critical patent/WO2013002778A1/en
Publication of WO2013002778A1 publication Critical patent/WO2013002778A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H30/00Remote-control arrangements specially adapted for toys, e.g. for toy vehicles
    • A63H30/02Electrical arrangements
    • A63H30/04Electrical arrangements using wireless transmission
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63HTOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
    • A63H27/00Toy aircraft; Other flying toys
    • A63H27/12Helicopters ; Flying tops
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • G05D1/104Simultaneous control of position or course in three dimensions specially adapted for aircraft involving a plurality of aircrafts, e.g. formation flying
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/388Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/356Image reproducers having separate monoscopic and stereoscopic modes
    • H04N13/359Switching between monoscopic and stereoscopic modes

Definitions

  • the present inventive concepts generally relate to systems and methods for displaying
  • 3-dimensional arrays of pixels and more particularly, to 3-dimensional luminous pixel arrays, 3-dimensional luminous pixel array control systems and methods of controlling 3- dimensional luminous pixel arrays.
  • 3-dimensional display devices comprise membranes or films that project an illusion of depth in a photograph, movie or other 2-dimensional image.
  • a 3-dimensional illusion can be projected to a viewer by displaying two 2-dimensional images, which represent two perspectives of the same photograph, movie or image.
  • Such 3- dimensional display devices generally require viewers to wear specialized eyeglasses.
  • some 3-dimensional projection devices such as swept- volume displays, comprise a plurality of image projectors that project images on a display surface undergoing rotational motion. As the display surface rotates, the images projected on the 2- dimensional display surface changes, which creates a 3-dimensional illusion.
  • 3-dimensional projection devices have limited viewing angles.
  • the present inventive concepts generally relate to systems and methods for displaying 3-dimensional arrays of pixels, and more particularly, to 3-dimensional luminous pixel arrays, 3-dimensional luminous pixel array control systems and methods of controlling 3- dimensional luminous pixel arrays.
  • embodiments described herein provide systems and methods for displaying and controlling 3-dimensional luminous pixel arrays that include a plurality of pixels, such as "flying pixels” or luminous flying vehicles, which move in 2-dimensional and 3-dimensional space.
  • Each flying pixel or luminous flying vehicle can be configured and/or controlled to move in 2-dimensional and/or 3-dimensional space, e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc., and can be configured and/or controlled to change its color and light intensity so as to create and/or render 2-dimensional and 3-dimensional images and shapes that can move in space.
  • 2-dimensional and/or 3-dimensional space e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.
  • MIT-14079PCT 1 Further, embodiments described herein provide systems and methods for displaying and controlling 2-dimensional and 3-dimensional image-creating events.
  • a plurality of flying pixels or luminous flying vehicles can be configured and/or controlled to execute synchronized motions in space to form a luminous display surface or canvas comprising a plurality of pixels.
  • the plurality of flying pixels or luminous flying devices can be arranged in space to form various 2-dimensional and 3-dimensional images and shapes.
  • the systems and methods described herein can be viewed from all directions.
  • a luminous pixel array comprises: a plurality of luminous flying vehicles configured to move in 3-dimensional space, wherein a first luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one pixel of the luminous pixel array, and wherein the first luminous flying vehicle is configured to radiate a first color and intensity of light.
  • the at least one pixel of the luminous pixel array may include a first pixel.
  • the at least one pixel of the luminous pixel array may further include a second pixel.
  • Each one of the plurality of luminous flying vehicles may correspond to a pixel of the luminous pixel array.
  • Each one of the plurality of luminous flying vehicles may correspond to one or more pixels of the luminous pixel array.
  • the first luminous flying vehicle may include at least one luminous element constructed and arranged to radiate the first color and intensity of light.
  • the at least one luminous element may include an RGB light emitting diode.
  • the at least one luminous element may include a red light emitting diode, a green light emitting diode and a blue light emitting diode.
  • the at least one luminous element may include one selected from the group consisting of: an electron stimulated device, an incandescent lamp device, an
  • the electroluminescent lamp device may include an electronic display device.
  • a second luminous flying vehicle of the plurality of luminous flying vehicles may correspond to at least one other pixel of the luminous pixel array.
  • the second luminous flying vehicle may include at least one luminous element constructed and arranged to radiate a second color and intensity of light.
  • the at least one luminous element may include at least one light emitting diode.
  • the at least one light emitting diode may include at least one phosphor-type light emitting diode or at least one organic light emitting diode.
  • the plurality of luminous flying vehicles may further be configured to move in 3- dimensional space so as to create 2-dimensional and 3 -dimensional shapes that can move in space.
  • a color and intensity of light may be radiated by each of the plurality of luminous flying vehicles so as to render 2-dimensional and 3 -dimensional images.
  • the plurality of luminous flying vehicles may include second through twenty- fifth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include second through fiftieth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include second through one-hundredth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include second through one-thousandth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include second through two-thousandth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include second through five- thousandth luminous flying vehicles.
  • the plurality of luminous flying vehicles may include at least two rotary- wing luminous flying vehicles.
  • the plurality of luminous flying vehicles may include at least two fixed- wing luminous flying vehicles.
  • the plurality of luminous flying vehicles may include at least two aerostat luminous flying vehicles.
  • the first luminous flying vehicle may be configured to radiate the first color and intensity of light for a first predetermined length of time, and may be further configured to radiate a second color and intensity of light for a second predetermined length of time.
  • the first luminous flying vehicle may include an optical identification element that emits radiation in a non- visible spectrum.
  • the optical identification element may include an infrared light emitting diode and/or a reflector.
  • Each luminous flying vehicle of the plurality of luminous flying vehicles may include an optical identification element.
  • the optical identification element may be constructed and arranged to emit radiation in a non-visible spectrum.
  • the first luminous flying vehicle may include at least one luminous element positioned on an outer surface of the first luminous flying vehicle.
  • the at least one luminous element may be positioned on the outer surface of a body of the luminous flying vehicle.
  • the at least one luminous element may be positioned on the outer surface of a gas chamber of the luminous flying device.
  • the first luminous flying vehicle may include at least one luminous element positioned within a body of the first luminous flying vehicle.
  • the at least one luminous element may be positioned within a central portion of the body.
  • the body of the first luminous flying vehicle may be translucent or opaque.
  • the first luminous flying vehicle may include a vehicle control system comprising: a micro-processing system; positioning and localization systems electrically connected to the micro-processing system; at least one luminous element electrically connected to the microprocessing system; a wireless transceiver connected to the micro-processing system; and a power source constructed and arranged to provide a current to the micro-processing system, the positioning and localization systems, the at least one luminous element and the wireless transceiver.
  • the micro-processing system may be configured to control a flight trajectory of the first luminous flying vehicle.
  • the micro-processing system may be further configured to control a color and light intensity of the at least one luminous element.
  • the micro-processing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to control commands received from a ground-based control system.
  • the micro-processing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to a predetermined flight trajectory stored in memory of the vehicle control system.
  • the positioning and localization systems may include a navigation positioning system receiver configured to determine a position of the first luminous flying vehicle.
  • the microprocessing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to the position of the first luminous flying vehicle.
  • a luminous pixel array system comprises: at least one luminous flying vehicle, the at least one luminous flying vehicle corresponding to at least one pixel of a luminous pixel array; and a control system configured to wirelessly communicate with the at least one luminous flying vehicle.
  • the at least one luminous flying vehicle may include a plurality of luminous flying vehicles.
  • Two luminous flying vehicles of the plurality of luminous flying vehicles may include one selected from the group consisting of: rotary-wing luminous flying vehicles, fixed-wing luminous flying vehicles and aerostat luminous flying vehicles.
  • the at least one luminous flying vehicle may include at least one luminous element constructed and arranged to emit radiation in the visible spectrum.
  • the at least one luminous element may include one selected form the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device.
  • the luminous pixel array system may further include an optical motion capture system configured to transmit captured images of the at least one luminous flying vehicle to the control system.
  • the optical motion capture system may include at least one infrared
  • the optical motion capture system may include at least one optical image capturing device.
  • the control system may be configured to reconstruct the spatial position of the at least one luminous flying vehicle based on the captured images.
  • the control system may be further configured to determine a position and trajectory of the at least one luminous vehicle based on the captured images.
  • the control system may be further configured to compute control commands based on a predetermined image-creating event stored in memory of the control system.
  • the control commands may be transmitted by the control system to the at least one luminous flying vehicle.
  • a vehicle control system of the luminous flying vehicle may alter at least one of a flight trajectory and a luminous element color and intensity according to the control commands received from the control system.
  • the predetermined image-creating event may include at least one of flight trajectory data and image/sequence data.
  • the flight trajectory data may include a plurality of desired spatial positions for the at least one luminous flying vehicle as a function of time.
  • the flight trajectory data may include a mathematical function describing a geometry of a flight trajectory of the at least one luminous flying vehicle as a function of time.
  • image/sequence data may include a plurality of luminous element color and intensity values for the at least one luminous flying vehicle as a function of time.
  • the control system may be configured to transmit the control commands to the at least one luminous flying vehicle.
  • the at least one luminous flying vehicle may execute synchronized motions in space corresponding to control commands received from the control system.
  • the optical motion capture system may be configured to transmit the captured images of the at least one luminous flying vehicle to the control system via at least one of a wired communication line and a wireless communication link.
  • the control system may include a memory device having a predetermined image-creating event stored therein.
  • the control system may be configured to preprogram the at least one luminous flying vehicle with a predetermined flight trajectory and image/sequence.
  • the at least one luminous flying vehicle may execute the image-creating event in response to the preprogramming of the
  • the control system may be further configured to transmit initialization and synchronization signals to the at least one luminous flying vehicle so as to coordinate the commencement and execution of the predetermined image-creating event by the at least one luminous flying vehicle.
  • the at least one luminous flying vehicle may include a plurality of luminous flying vehicles.
  • a luminous pixel array comprises: a plurality of luminous flying vehicles arrange in 3 -dimensional space, wherein each luminous flying vehicle corresponds to at least one pixel of the luminous pixel array, and wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum.
  • the plurality of luminous flying vehicles may be arranged in space so as to form a 2- dimensional canvas in space. Each of the plurality of luminous flying vehicles may be configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to render first and second 2-dimensional images in space.
  • the plurality of luminous flying vehicles may be suspended in space.
  • the plurality of luminous flying vehicles may be airborne.
  • the plurality of luminous flying vehicles may be arranged in space so as to form a 3 -dimensional shape in space.
  • Each of the plurality of luminous flying vehicles may be configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to create first and second 3 -dimensional shapes in space.
  • FIG. 1 is an architectural view of 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts
  • FIGs. 2A-2D illustrate luminous flying vehicles in accordance with embodiments of the present inventive concepts
  • FIG. 2E is a block diagram of a control circuit of a luminous flying vehicle in accordance with embodiments of the present inventive concepts
  • FIG. 3A illustrates a centralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts
  • FIG. 3B illustrates a decentralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts
  • FIG. 3C illustrates a hybrid localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts
  • FIG. 4 A is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts
  • FIG. 4B is a block diagram of a 3-dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts
  • FIG. 5A is a block diagram of a centralized localization control system and method of controlling a 3-dimensional luminous pixel array in accordance with embodiments of the present inventive concepts
  • FIG. 5B is a block diagram of a decentralized localization control system and method of controlling a 3-dimensional luminous pixel array in accordance with embodiments of the present inventive concepts
  • FIGs. 6A and 6B are block diagrams illustrating luminous flying vehicle control systems in accordance with embodiments of the present inventive concepts
  • FIGs. 7A, 7B, 8A and 8B are flow diagrams illustrating methods of controlling luminous flying vehicles in accordance with embodiments of the present inventive concepts
  • FIGs. 9A-9C illustrate 3-dimensional luminous pixel arrays in accordance with embodiments of the present inventive concepts.
  • FIG. 1 is an architectural view of 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts.
  • a 3 -dimensional pixel array system 100 can comprise a plurality of luminous flying vehicles 200, a control system 300, at least one of a navigation positioning system 150 and/or a motion capture system 160 such as an optical motion capture system.
  • the 3 -dimensional pixel array system 100 can comprise two or more luminous flying vehicles 200; however, in other embodiments, the 3 -dimensional pixel array system 100 can comprise a single luminous flying vehicle 200.
  • each luminous flying vehicle 200 corresponds to single pixel of a 3 -dimensional pixel array. However, in other embodiments, each luminous flying vehicle 200 can correspond to two or more pixels of a 3 -dimensional pixel array.
  • each luminous flying vehicle 200 can comprise two or more luminous elements 230, such as the luminous flying vehicle 200 illustrated in FIG. 2 A.
  • a luminous flying vehicle 200 having two or more luminous elements 230 can be configured to operate as a single pixel, wherein each of the two or more luminous elements 230 operate in unison, or can be configured to operate as two or more pixels, wherein each of the two or more luminous elements 230 operate independently of one another.
  • each luminous flying vehicle 200 can comprise a single luminous element 230.
  • each luminous flying vehicle 200 can comprise a space-based global navigation satellite system receiver, such as a Global Positioning System (GPS) receiver and/or a Galileo Satellite Navigation receiver that can be configured to receive broadcast signals from one or more navigation positioning systems 150, such as GPS satellites and/or Galileo satellites.
  • GPS Global Positioning System
  • Galileo Satellite Navigation receiver that can be configured to receive broadcast signals from one or more navigation positioning systems 150, such as GPS satellites and/or Galileo satellites.
  • each luminous flying vehicle 200 can comprise an earth-based global navigation satellite system receiver, such as an emulated Global Positioning System (eGPS) receiver, that can be configured to receive broadcast signals from one or more navigation positioning systems 150, such as eGPS systems.
  • An eGPS may include one or more beacons that are configured to emit signals similar to those emitted by GPS satellites and/or Galileo satellites.
  • the one or more beacons can be arranged about a periphery of an operating volume to emit emulated positioning signals.
  • these beacons of an eGPS may be arranged in areas where conventional GPS and/or Galileo positioning signals are weak or non-existent, which can occur when there is an obstructed line of sight to one or more GPS or Galileo satellites.
  • luminous flying vehicles 200 having satellite system receivers can determine their position in space on-board. That is, each luminous flying vehicle 200 having a satellite system receiver can independently determine its position in space without the aid of the control system 300. Further, in some embodiments, the luminous flying vehicles 200 having satellite system receivers can be configured to transmit their position in space to the control system 300 and/or to one or more other luminous flying vehicles 200.
  • the luminous flying vehicles 200 can be controlled via a control system 300, such as a server cluster, a computer system or other type of electronic control system.
  • the control system 300 can comprise a wireless transceiver 310 that is configured to transmit control data to the two or more luminous flying vehicles 200.
  • the control system 300 and/or the wireless transceiver 310 is/are configured to broadcast control data packets to each of the two or more luminous flying vehicles 200.
  • the control system 300 and/or the wireless transceiver 310 is/are configured to multicast control data packets to one or more luminous flying vehicles 200.
  • the control system 300 and/or the wireless transceiver 310 is/are configured to unicast control data packets to one of the luminous flying vehicles 200.
  • a control system 300 such as a server cluster, a computer system or other type of electronic control system.
  • the control system 300 can comprise a wireless transceiver 310 that is configured to transmit control data to the two or more luminous flying vehicles 200.
  • control system and/or wireless transceiver 310 is/are configured to receive vehicle data from one or more of the luminous flying vehicles 200.
  • the control commands transmitted by the control system 300 can comprise at least one of position data (e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.), flight and trajectory data (e.g., direction and speed of flight) and image data (e.g., luminous element color and intensity) for one or more luminous flying vehicles 200.
  • position data e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.
  • flight and trajectory data e.g., direction and speed of flight
  • image data e.g., luminous element color and intensity
  • the vehicle data transmitted to the control system 300 can comprise at least one of GPS position data, RSSI position data, flight and trajectory data, and system diagnostic data (e.g., system health, battery charge, etc.).
  • system diagnostic data e.g., system health, battery charge, etc.
  • transmitting includes various types data packet routing and distribution schemes, including but not limited to: anycast schemes, broadcast schemes, multicast schemes and unicast schemes.
  • the control system 300 can comprises a motion capture system 160 such as an optical motion capture system.
  • the optical motion capture system can comprise one or more image capturing devices or infrared (IR) cameras.
  • the motion capture system 160 can be configured to track the position of one or more luminous flying devices 200 by capturing one or more images of the luminous flying vehicles 200, and allows the control system 300 to reconstruct the spatial position of the one or more luminous flying vehicles 200.
  • the motion capture system 160 may include a digital optical motion capture system, such as a Vicon optical motion capture system by Vicon Motion Systems of Centennial, CO, USA, a division of OMG pic of Oxford, UK or a optical motion capture system by
  • the motion capture system 160 may include at least three cameras positioned about an operating volume so that each luminous flying vehicle 200 of the system 100 is visible by at least there cameras of the system 100.
  • the control system 300 may reconstruct the spatial position of the luminous flying vehicles 200 based on the images captured by the cameras of the motion capture system 160.
  • FIGs. 2A-2D illustrate luminous flying vehicles in accordance with exemplary embodiments of the present inventive concepts.
  • Luminous flying vehicles 200 such as fixed- wing luminous flying vehicles 270, rotary-wing luminous flying vehicles 280 and aerostat luminous flying vehicles 290, can comprise control circuitry 201 (see for example, FIG. 2E) including one or more luminous elements 230, 230a-d and an optional optical identification element 231.
  • rotary-wing luminous flying vehicles 280 are heavier-than-air flying machines that use lift generated by wings, such as rotor blades, that revolve around a body to achieve flight.
  • fixed-wing luminous flying vehicles 270 are heavier- than-air flying machines that use forward motion to generate lift via wings mounted to a body to achieve flight.
  • aerostat luminous flying vehicles 290 are lighter- than-air flying machines that achieve flight primarily through the use of buoyant lighter-than- air gases housed in a chamber.
  • each luminous flying vehicle 200 described herein can comprise varying amounts of luminous elements 230.
  • each luminous flying vehicle 200 can comprise one or more luminous elements 230.
  • each luminous flying vehicle 200 can comprise two or more luminous elements 230 that can be configured to operate in sequence so as to form a single pixel.
  • each luminous flying vehicle 200 can comprise two or more luminous elements 230 that can be configured to operate independently of one another so as to form two or more pixels.
  • the luminous elements 230 can comprise one or more electric powered luminous devices, such as electron stimulated devices, incandescent lamp devices, electroluminescent lamp devices, gas discharge lamp devices and high-intensity discharge lamp devices.
  • electric powered luminous devices such as electron stimulated devices, incandescent lamp devices, electroluminescent lamp devices, gas discharge lamp devices and high-intensity discharge lamp devices.
  • Examples of electron stimulated devices include electron stimulated luminescence (ESL) light bulbs and cathode ray tub (CRT) devices.
  • Examples of electroluminescent lamps include light-emitting diodes (LEDs), such as organic LEDs, polymer LEDs, solid-state lighting, LED lamps, electroluminescent sheets and electroluminescent wires.
  • Examples of gas discharge lamp devices include fluorescent lamps, compact fluorescent lamps (CFLs), neon and argon lamps, plasma lamps and xenon flash lamps.
  • Examples of high-intensity discharge lamp devices include carbon arc lamps, ceramic discharge metal halide lamps, hydrargyrum medium-arc iodide lamps, mercury- vapor lamps, metal halide lamps, sodium vapor lamps and xenon arc lamps.
  • the luminous elements 230 can further comprise electronic display devices such as
  • LED displays electroluminescent displays (ELDs), plasma display panels (PDPs), liquid crystal displays (LCDs), thin-film transistor displays (TFTs), organic light-emitting diode displays (OLEDs) and surface-conduction electron-emitter displays (SEDs).
  • ELDs electroluminescent displays
  • PDPs plasma display panels
  • LCDs liquid crystal displays
  • TFTs thin-film transistor displays
  • OLEDs organic light-emitting diode displays
  • SEDs surface-conduction electron-emitter displays
  • the optional optical identification element 231 can comprise one or more infrared light-emitting diodes (IRLEDs), which, in some embodiments, can be tracked via the optical motion capture system 160 of the control system 300.
  • the optical identification element 231 may include a reflector that reflects a predetermined spectrum of light.
  • the system 100 may further include one or more light sources 161 that illuminate the operating volume with the predetermined spectrum of light, such as infrared light (see light sources 161 illustrated in FIG. 1). Accordingly, luminous flying vehicles 200 within the operating volume may reflect the light emitted by the one or more lights sources, which in turn can be captured by the optical motion capture system 160.
  • a luminous flying vehicle 200 such as a rotary-wing luminous flying vehicle 280
  • a luminous flying vehicle 200 can comprise a main body 220 and one or more propellers 210.
  • the rotary-wing luminous flying vehicle 280 can comprise a quad-rotor helicopter design having first through fourth propellers 211-214 mounted vertically with respect to the main body 220 so as to provide lift and stability control.
  • the rotary-wing luminous flying vehicles 280 can be controlled in all axes of space.
  • the rotary- wing luminous flying vehicle 280 comprises a plurality of luminous elements 230, 230a-d positioned on sides of the main body 220 of the rotary-wing luminous flying vehicle 280.
  • an optional optical identification element 231 is shown positioned on a lower portion of the main body 220 of the rotary-wing luminous flying vehicle 280.
  • the luminous elements 230, 230a-d can be positioned within a central portion of the main body 220 of the rotary- wing luminous flying vehicle 280.
  • the luminous elements 230, 230a-d can emit light from outer surfaces of a translucent or opaque main body 220. That is, in some embodiments, the luminous elements 230, 230a-d can emit light from the entire circumference CR (i.e., 360°) of the main body 220 of the rotary- wing luminous flying vehicle 280.
  • a luminous flying vehicle 200 such as a fixed-wing luminous flying vehicle 270
  • the fixed- wing luminous flying vehicle 280 comprises a plurality of luminous elements 230 positioned on the wings 210 and/or main body 220 of the vehicle 270.
  • an optional optical identification element 231 is shown positioned on a lower portion of the main body 220.
  • a luminous flying vehicle 200 such as a rotary-wing luminous flying vehicle 280, can comprise a main body 220 and one or more propellers 210.
  • a luminous flying vehicle 200 such as a rotary-wing luminous flying vehicle 280, can comprise a main body 220 and one or more propellers 210.
  • the rotary- wing luminous flying vehicle 280 can comprise a dual-rotor helicopter design having first and second propellers 211-212 so as to provide lift and stability control.
  • the rotary-wing luminous flying vehicle 280 comprises a plurality of luminous elements 230, positioned on sides of the main body 220 and/or lower rails of the main body 220.
  • an optional optical identification element 231 is shown positioned on a lower portion of the main body 220 of the rotary-wing luminous flying vehicle 280.
  • a luminous flying vehicle 200 such as aerostat luminous flying vehicle 290
  • the aerostat luminous flying vehicle 280 comprises a plurality of luminous elements 230, positioned on sides of the main body 220 and/or sides of the gas chamber 221.
  • the luminous element(s) 230 positioned on the sides of the gas chamber 221 can comprise, for example, a multi-pixel display device or panel.
  • FIG. 2E is a block diagram of a control system of a luminous flying vehicle in accordance with embodiments of the present inventive concepts.
  • a vehicle control system 201 can comprise a micro-processing system 241, positioning and localization systems 243, luminous elements 230, optional optical identification elements 231, wireless transceivers 244, flight control systems 242 and a power source 240. Some elements having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
  • the micro-processing system 241 can comprise one or more processors that are capable of communicating with and controlling the positioning and localization systems 243, the luminous elements 230, the optical identification elements 231, the wireless transceivers 244 and the flight control systems 242 of the vehicle control system 201. In this manner, the micro-processing system 241 can control the flight path of the luminous flying vehicle 200, along with the color and/or light intensity of the luminous elements 230 positioned thereon.
  • the positioning and localization systems 243 can comprise a 3- axis accelerometer, a gyroscope, a magnetometer and a navigation positioning system receiver, and can communicate positioning and localization data and/or vehicle data to the micro-processing system 241.
  • the micro-processing system 241 can configure the wireless transceiver 244 to transmit vehicle data to the control system 300 and/or other luminous flying vehicles 200.
  • the positioning and localization systems 243 may be configured to determine a position of the luminous flying vehicle 200 via one or more of the following positioning
  • MIT-14079PCT 13 systems GPS, eGPS, Ultrasonic receiver systems and received signal strength indicator (RSSI) systems.
  • RSSI received signal strength indicator
  • positioning and localization systems 243 including ultrasonic receiver systems may include an ultrasonic receiver configured to receive ultrasonic chirps from a plurality of ultrasonic transmitters placed about an operating volume.
  • Ultrasonic transmitters having known positions, can be configured to successively emit ultrasonic chirps with a time delay between the chirps of different transmitters.
  • a synchronization event prior to the emission of a sequence of chirps may allow the ultrasonic receiver system to calculate time of flight information so that a position of the luminous flying vehicle 200 can be determined.
  • Positioning and localization systems 243 including RSSI systems can include a radio transceiver configured to determine radio signal strength of a signal emitted by a radio transceiver of another luminous flying vehicle 200. The signal strength can then be used to estimate the distance to a radio transmitter.
  • the system 100 may include several identifiable transmitters positioned about the operating volume to allow the receivers to triangulate their positions in 3D space.
  • the RSSI system can be included within the wireless transceiver 233 (e.g., ZigBee transceivers).
  • the wireless transceiver 244 can comprise a wireless sensor network transceiver, such as a ZigBee transceiver, a EnOcean transceiver, Personal area network transceiver, a
  • Bluetooth transceiver can further comprise a wireless network transceiver, such as a Wireless LAN (WLAN) transceiver (e.g., IEEE 802.11, WiFi) and/or a Broadband Fixed Access (BWA) transceiver (e.g., LMDS, WiMAX).
  • WLAN Wireless LAN
  • BWA Broadband Fixed Access
  • the wireless transceiver 244 can be configured to communicate with one or more wireless transceivers 244 of other luminous flying vehicles 200 and/or with a wireless transceiver 310 of a control system 300.
  • the flight controls 242 can comprise various motor drivers, actuating systems and control devices that are associated with the flight control of the luminous flying vehicles 200 described herein.
  • the power source 240 can comprise one or more batteries configured to provide electrical power to the systems, devices and elements of the vehicle control system 201.
  • FIGs. 3A-3C illustrate various systems and methods of controlling a 3-dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts.
  • a 3-dimensional luminous pixel array system can comprise a plurality of luminous flying vehicles 200, 200a-d and an optional vehicle charging station 400.
  • MIT-14079PCT 14 having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
  • the optional vehicle charging station 400 can be provided with a 3 -dimensional luminous pixel array system.
  • the vehicle charging station 400 can be constructed and arranged to charge the power source 240 of one or more of the luminous flying vehicles 200, 200a-d.
  • the vehicle charging station 400 is constructed and arranged to provide a charging current to one or more of the luminous flying vehicles 200, 200a-d via a wired connection.
  • the vehicle charging station 400 is constructed and arranged to provide a charging current to one or more of the luminous flying vehicles 200, 200a-d via a wireless connection (e.g., induction charging).
  • a wireless connection e.g., induction charging
  • a 3-dimensional luminous pixel array system can comprise a single flying pixel or luminous flying vehicle, or can comprise any number of flying pixels or luminous flying vehicles.
  • a 3-dimensional luminous pixel array system can comprise at least 25 flying pixels or luminous flying vehicles 200.
  • a 3- dimensional luminous pixel array system can comprise at least 50 flying pixels or luminous flying vehicles 200.
  • a 3-dimensional luminous pixel array system can comprise at least 100 flying pixels or luminous flying vehicles 200.
  • a 3-dimensional luminous pixel array system can comprise at least 1000 flying pixels or luminous flying vehicles 200.
  • a 3-dimensional luminous pixel array system can comprise at least 2000 flying pixels or luminous flying vehicles 200.
  • a 3-dimensional luminous pixel array system can comprise at least 5000 flying pixels or luminous flying vehicles 200.
  • centralized localization and “off-board localization” as used herein relate to systems and methods for controlling a 3- dimensional luminous pixel array wherein the position of each luminous flying vehicle is determined by one or more systems, devices or elements that are separate from each luminous flying device.
  • the terms “decentralized localization” and “on-board localization” as used herein relate to systems and methods for controlling a 3- dimensional luminous pixel array wherein the position of each luminous flying vehicle is determined by one or more systems, devices or elements that are part of each luminous flying device.
  • hybrid localization defines systems and methods for controlling a 3-dimensional luminous pixel array
  • each luminous flying vehicle is determined by one or more systems, devices or elements that are part of each luminous flying device and one or more systems, devices or elements that are separate from each luminous flying device.
  • FIG. 3A illustrates a centralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts.
  • the spatial positions of a plurality of luminous flying vehicles 200, 200a-c can be determined and/or tracked by an off-board system, such as a control system 300 having a motion capture system 160 such as an optical motion capture system (e.g., optical image/video capturing device) or an electromagnetic object detection system (e.g., radar devices and systems).
  • a motion capture system 160 such as an optical motion capture system (e.g., optical image/video capturing device) or an electromagnetic object detection system (e.g., radar devices and systems).
  • an optical motion capture system e.g., optical image/video capturing device
  • an electromagnetic object detection system e.g., radar devices and systems
  • the motion capture system 160 comprises one or more optical motion capture devices 160a-c, which can comprise image capturing devices such as infrared (IR) cameras.
  • a first motion capture device 160a is electrically connected to the control system 300 via a wired communication line 165a
  • second and third motion capture devices 160b, 160c are wirelessly connected to the control system 300 via wireless communication links 165b, 165c; however, various other wired and wireless configurations are possible.
  • each motion capture device 160a-c can be connected to the control system 300 via one or more wired communication lines, or each motion capture device 160a-c can be wirelessly connected to the control system 300 via one or more wireless communication links.
  • the motion capture system 160 can be configured to track the positions of the plurality of luminous flying vehicles 200, 200a-c by capturing images of the swarm 250 of luminous flying vehicles 200, 200a-c.
  • each luminous flying vehicle 200, 200a-c can be provided with an identification element 231, such as an infrared light-emitting diode, that can be tracked by the motion capture system 160.
  • the identification element can emit radiation in a non-visible spectrum so as not to interfere with radiation emitted by the luminous elements 230 of the luminous flying vehicles 200.
  • the control system 300 can reconstruct the spatial positions of each luminous flying vehicle 200, 200a-c of the swarm 250, and compute control commands to transmit to the plurality of luminous flying vehicles 200, 200a-c.
  • IRLEDs of the optical identification elements 231 of each luminous vehicle can be configured to continuously emit radiation in a non- visible spectrum; however, in other embodiments, the IRLEDs may be configured to pulse in various different frequencies so as to emit vehicle identification pulses.
  • the optical tracking systems 160 may
  • MIT-14079PCT 16 capture the radiation emitted by the IRLEDs, which can be output as a set of points in 3D corresponding to marker locations.
  • the control system may be configured to update the position estimates for all of the luminous flying vehicles 200.
  • the identification of the luminous flying vehicles 200 can be based on a semi-manual initialization of a point- cloud. For example, this can be accomplished by arranging the luminous flying vehicles 200 in a set initialization arrangement, and labeling one or two of the luminous flying vehicles 200 manually in software and allowing the rest to be labeled automatically.
  • the control commands can be transmitted by the control system 300 via the wireless transceiver 310, and can comprise position data (e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.), flight and trajectory data (e.g., direction and speed of flight) and image data (e.g., luminous element color and light intensity).
  • position data e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.
  • flight and trajectory data e.g., direction and speed of flight
  • image data e.g., luminous element color and light intensity
  • control system 300 can compute control commands to transmit to each of the luminous flying vehicles 200, 200a-c using, for example, a fixed control law that is dependent upon the type of vehicle and the on-board control software of each vehicle.
  • the plurality flying pixels or luminous flying vehicles 200, 200a-c can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3-dimensional luminous display surfaces or canvases comprising a plurality of pixels.
  • FIG. 3B illustrates a decentralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts.
  • the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by on-board systems of the luminous flying vehicles 200, 200a-d, such as vehicle control systems 201 having positioning and localization systems 243.
  • a plurality of navigation positioning systems 150, 150a-b are provided, which can broadcast positioning signals to the luminous flying vehicles 200, 200a-d.
  • the vehicle control systems 201 and/or the positioning and localization systems 243 of the vehicles 200, 200a-d can be configured to receive the positioning signals from one or more of the navigation positioning systems 150, 150a-b, and can be configured to determine the spatial position of each vehicle 200, 200a-d in response to the received positioning signals.
  • the luminous flying vehicles 200, 200a-d can be configured to execute a flight trajectory in space, along with a sequence of image data commands (e.g., pixel color
  • the plurality flying pixels or luminous flying vehicles 200, 200a- d can be configured and/or controlled to execute synchronized motions in space to form 2- dimensional and 3 -dimensional luminous display surfaces or canvases comprising a plurality of pixels.
  • a control system 300 which can preprogram the luminous flying vehicles 200, 200a-d to execute a predetermined image-creating event.
  • a predetermined image-creating event can comprise a predetermined flight trajectory for each of the luminous flying vehicles 200, 200a-d and a predetermined sequence of image data commands for each of the luminous flying vehicles 200, 200a-d.
  • the control system 300 can transmit an initialization and
  • a control system 300 can program the luminous flying vehicles 200, 200a-d to execute an image-creating event that can be updated from time to time, or in real-time.
  • an image-creating event can comprise a flight trajectory for each of the luminous flying vehicles 200, 200a-d and a sequence of image data commands for each of the luminous flying vehicles 200, 200a-d that can be updated by the control system 300.
  • the control system 300 can be configured to transmit the updated image-creating event to each of the luminous flying vehicles 200, 200a-d.
  • FIG. 3C a hybrid localization system and method of controlling a 3 -dimensional luminous pixel array in accordance with embodiments of the present inventive concepts.
  • the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by both an off-board system, such as a control system 300 having a motion capture system 160 (described above with reference to FIG. 3 A) and an on-board system, such as vehicle control systems 201 having positioning and localization systems 243 (described above with reference to FIG. 3B).
  • an off-board system such as a control system 300 having a motion capture system 160 (described above with reference to FIG. 3 A)
  • an on-board system such as vehicle control systems 201 having positioning and localization systems 243 (described above with reference to FIG. 3B).
  • FIG. 4 A is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts.
  • a 3-dimensional luminous pixel array system can comprise a control system 300, an motion capture system 160 such as an optical motion capture system and a plurality of luminous flying vehicles 200, and can be configured in a centralized localization mode.
  • control system 300 can configure the motion capture system 160 to capture images and/or position information of a swarm of luminous flying vehicles 200. In response to receiving the captured image data and/or position
  • the control system 300 can reconstruct the spatial positions of each luminous flying vehicle 200 of the swarm. As a result, the control system 300 can compute control commands, and can transmit the control commands to the swarm of luminous flying vehicles 200 so as to execute an image-creating event.
  • control system 300 can direct the execution of image-creating events by controlling the flight trajectory and position of each of the luminous flying vehicles 200 of the swarm, and can further control the pixel color and light intensity of each of the luminous flying vehicles 200 of the swarm.
  • FIG. 4B is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts.
  • a 3 -dimensional luminous pixel array system can comprise a control system 300, one or more navigation positioning systems 150 and a plurality of luminous flying vehicles 200, and can be configured in a decentralized localization mode.
  • control system 300 can be configured to transmit flight trajectory data and image sequence data to each of the luminous flying vehicles 200 of the swarm, and can be further configured to transmit an initialization and synchronization signal to the swarm of luminous flying vehicles 200.
  • flight trajectory data and image sequence data is preprogrammed in system memory of each of the luminous flying vehicles 200 of the swarm prior to commencement of the image- creating event; however, in some embodiments, flight trajectory data and image sequence data is transmitted before and during the execution of the image-creating event. In some embodiments, flight trajectory data and image sequence data is updated during the execution of the image-creating event.
  • each of the luminous flying vehicles 200 of the swarm can be configured to determine its spatial position from positioning signals broadcast by the one or more navigation positing systems 150, and can be further configured to compute flight trajectory commands and image sequence commands based on its determined spatial position, and the flight trajectory data and the image sequence data received from the control system 300.
  • each of the luminous flying vehicles 200 of the swarm can be configured to execute an image-creating event according to flight trajectory data and a image sequence data, and can commence and execute the image-creating event in response to the initialization and synchronization signals transmitted by the control system 300.
  • FIG. 5A is a block diagram of a centralized localization control system and method for controlling a 3-dimensional luminous pixel array in accordance with embodiments of the
  • a control system 300 can be configured as a centralized localization control system, and can comprise a processor 301, an input/output (I/O) device 310, a memory device 320 and a wireless transceiver 244.
  • the memory device 320 can comprise random access memory (RAM), read only memory (ROM) or other type of memory device, and can be indirectly or directly connected to the processor 301. In some embodiments, the memory device can be integrated within the processor device 301.
  • the I/O device 310 can comprise various types of I/O devices known in the art, such as a universal serial bus (USB) interface device, a serial interface device (e.g., RS-232, 12C, SPI), a Firewire interface device (i.e., IEEE 1394) or a combination thereof.
  • USB universal serial bus
  • serial interface device e.g., RS-232, 12C, SPI
  • Firewire interface device i.e., IEEE 1394
  • the motion capture system 160 can transmit captured images and/or position data of a swarm of luminous flying vehicles 200 to the control system 300 via at least one of a wired communication line 165a connected to the I/O device 310 and a wireless communication link 165b/c with the wireless transceiver 244.
  • the control system 300 can post-process the captured images and/or position data so that positions and trajectories of the luminous flying vehicles 200 of the swarm can be determined.
  • the processor 301 can be configured to estimate the positions and trajectories of the luminous flying vehicles 200 of the swarm, and can compute control commands to be transmitted via the wireless transceiver 244 to each of the luminous flying vehicles 200 of the swarm.
  • the control commands can comprise position data commands, such as Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc., flight data commands, such as direction and speed of flight, and image date commands, such as luminous element color and intensity for each of the luminous flying vehicles 200 of the swarm.
  • the processor 301 can be configured to compute the control commands based on a predetermined image-creating event stored in the memory device 320 of the control system 300 or based on a variable image-creating event.
  • the image-creating event can comprise flight trajectory data 340 for each luminous flying vehicle 200 of the swarm and can comprise image/sequence data 350 for each luminous flying vehicle 200 of the swarm.
  • the flight trajectory data 340 can comprise the desired spatial position of each luminous flying vehicle 200 of the swarm as a function of time
  • the image/sequence data 350 can comprise luminous element 230 color and
  • the flight trajectory data 340 can comprise a mathematical function describing the geometry of the flight trajectory for each flying vehicle 200 of the swarm.
  • control system 300 can direct the execution of image-creating events by controlling the flight trajectory and position of each luminous flying vehicle 200 of the swarm, and can further control the pixel color and light intensity of each luminous flying vehicle 200 of the swarm.
  • the swarm of luminous flying vehicles can be configured and/or controlled to execute synchronized motions in space to form luminous display surfaces of varying shapes and colors.
  • FIG. 5B is a block diagram of a decentralized localization control system and method of controlling a 3 -Dimensional luminous pixel array in accordance with embodiments of the present inventive concepts.
  • a control system 300 can be configured as a decentralized localization control system, and can comprise a processor 301, a memory device 320 and a wireless transceiver 244.
  • control system 300 can be configured to transmit flight trajectory data 340 and image sequence/data 350 stored in the memory device 320 to each of the luminous flying vehicles 200 of the swarm via the wireless transceiver 244.
  • control system 300 is configured to preprogram each of the luminous flying vehicles 200 with flight trajectory data 340 and image/sequence data 350 prior to execution of an image-creating event.
  • control system 300 is configured to transmit the flight trajectory data 340 and image sequence data 350 during the execution of an image-creating event.
  • control system 300 can be further configured to transmit an initialization and synchronization signal to each of the luminous flying vehicles 200 of the swarm so as to coordinate the commencement and execution of an image-creating event.
  • control system can transmit flight data and image/sequence data to each of the luminous flying vehicles 200 of the swarm, and can be configured to initialize an image-creating event by transmitting initialization and synchronization signals to the swarm of luminous flying vehicles 200.
  • FIGs. 6A and 6B are block diagrams illustrating luminous flying vehicle control systems in accordance with embodiments of the present inventive concepts. Some elements having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
  • a control system 201 of a luminous flying vehicle 200 can comprise micro-processing system 241, positioning and localization systems 243, luminous elements 230, optional optical identification elements 231 , wireless transceivers 244, flight control systems 242, flight motors and actuating systems 245 and one or more power sources 240.
  • the spatial positions of a plurality of luminous flying vehicles 200, 200a-c can be determined and/or tracked by an off- board system, such as a control system 300 having a motion capture system 160 such as an optical motion capture system (e.g., optical image/video capturing device) or an
  • each of the plurality of luminous flying vehicles 200 may include an optical ID element, such as an IRLED and/or a reflector, which can emit radiation. This radiation can then be captured by a motion capture system 160, and positions of each of the luminous flying vehicles 200 can be determined and/or tracked by a control system 300.
  • the control system 300 may then transmit control commands to each of the luminous flying vehicles 200 via wireless communication links.
  • the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by onboard systems of the luminous flying vehicles 200, 200a-d, such as vehicle control systems 201 having positioning and localization systems 243.
  • the positioning and localization systems 243 of each luminous flying vehicle 200 may include one or more subsystems 243 a-c, which can be selected from the group consisting of: a 3-axis accelerometer, a gyroscope, a magnetometer and a navigation positioning system receiver.
  • the luminous flying vehicles 200 can be configured to execute a flight trajectory in space, along with a sequence of image data commands (e.g., pixel color and intensity), which can be stored in system memory 255.
  • image data commands e.g., pixel color and intensity
  • FIGs. 7A, 7B, 8A and 8B are flow diagrams illustrating methods of controlling a luminous flying vehicles, in accordance with embodiments of the present inventive concepts.
  • unique sets of instructions can be implemented by the systems and devices described herein, or equivalent systems, executing a unique set of instructions stored in system or device memory.
  • a unique set of instructions can be implemented or embodied in software, firmware, or a combination thereof.
  • the unique set of instructions stored in system memory transform the systems and devices into particular, special purpose systems that can operate, for example, according to the following exemplary flow diagrams.
  • unique sets of instructions can be implemented or embodied in software, firmware, or a combination thereof.
  • MIT-14079PCT 22 correspond to the operations and methods described in connection with the following flow diagrams.
  • FIG. 7 A is a flow diagram of a method 700 of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts.
  • a control system 300 may be configured according to a centralized localization scheme, for example, as described above with reference to FIGs. 3 A and 4A.
  • the control system 300 may be provided with an optical tracking application 705 that configures the control system 300 to communicate with one or more optical motion capture systems 160.
  • the optical tracking application 705 may configure the control system 300 to perform an initialization of the one or more optical motion capture systems 160 connected to the control system 300 (710).
  • the control system 300 may begin processing raw data, such as optical image data, received from the one or more optical motion capture systems 160 (715).
  • the raw data may include optical images of a swarm of one or more luminous flying vehicles 200.
  • the control system 300 may generate point clouds that represent the positions of one or more luminous vehicles 200 of a swarm (715).
  • the control system 300 may be configured to generate one or more sets of 3 -dimensional points corresponding to 3 -dimensional locations of the one or more luminous flying vehicles 200.
  • the points may correspond to the location of transmission of optical identification elements 231 of each of the luminous flying vehicles 200 of the swarm.
  • the control system 300 may be further configured to transmit the one or more sets of 3- dimensional points to one or more other control systems connected to the control system 300 (720).
  • the control system 300 may be configured to transmit the one or more sets of 3-dimensional points to one or more other control systems connected to the control system 300 via a wired or wireless network.
  • the control system 300 and/or another control system may be provided with a vehicle control application 725, which may be executed in parallel with the optical tracking application 705.
  • the vehicle control application 725 may configure the control system 300 and/or other control system to compute positions, movements, image commands and/or other control signals that may be transmitted to the one or more luminous flying vehicles 200 of the swarm.
  • control system 300 may require that each of the points of a point cloud be mapped with a luminous flying vehicle 200 of the
  • MIT-14079PCT 23 swarm 730.
  • a user of the control system 300 may map points of a point cloud with the luminous flying vehicles 200 of the swarm (735).
  • the initial mapping of points of the point cloud may be fully automated by the control system 300.
  • the control system 300 may be further configured to estimate the positions of the luminous flying vehicles 200 of the swarm based on the one or more sets of 3 -dimensional points (745).
  • the estimation of the positions of the luminous flying vehicles 200 may be further based on previous sets of 3 -dimensional points and/or dynamic models describing the behavior of the luminous flying vehicles 200.
  • the control system 300 may be configured to continuously estimate the positions of the luminous flying vehicles 200 of the swarm at a rate less then or equal to a rate of the generation of the sets of 3 -dimensional points.
  • the control system 300 maybe further configured to generate vehicle trajectory and color command signals based on the estimated positions of the luminous flying vehicles 200 of the swarm (755).
  • the vehicle trajectory and color command signals are generated at a fixed frequency, which may be controlled according to a fixed control period (750).
  • the control system 300 may be configured to transmit the vehicle trajectory and color command signals to the luminous flying vehicles 200 of the swarm (760).
  • the luminous flying vehicles 200 can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3- dimensional luminous display surfaces or canvases comprising a plurality of pixels.
  • FIG. 7B is a flow diagram of a method 701 of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts.
  • Luminous flying vehicles 200 of a swarm may be configured according to a decentralized localization scheme, for example, as described above with reference to FIGs. 3B and 4B.
  • the luminous flying vehicles 200 of a swarm may be configured to commence an initialization procedure upon power-up (765). For example, a basic initialization and configuration of the micro-controllers 341 of the luminous flying vehicles 200 of the swarm may be performed. In addition, other devices of the luminous flying vehicles 200, such as wireless transceivers 244 (770) and/or positioning and localization systems 243 may be initialized during the initialization procedure (775).
  • the luminous flying vehicles 200 of the swarm may further be configured to undergo a zero heading calibration routine, which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (780).
  • a zero heading calibration routine which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (780).
  • MIT-14079PCT 24 luminous flying vehicles 200 of the swarm may be positioned in an orientation that is to be defined as the default or zero heading orientation while positioning and localization systems 243 of each of the luminous flying vehicles 200 calibrate.
  • the luminous flying vehicles 200 of the swarm may be configured to commence performance of a luminous flying sequence or event (785). During performance of a luminous flying sequence or event, the luminous flying vehicles 200 may be configured to access data from the positioning and localization systems 243 (795) and/or generate control commands (790) at a predetermined, fixed frequency (786, 787).
  • the luminous flying vehicles 200 of the swarm may further be configured to transmit and receive data from other luminous flying vehicles 200 of the swarm and/or a control system 300 (799).
  • the luminous flying vehicles 200 of the swarm may further be configured to update the color and intensity of the one or more luminous elements 230 of each of the luminous flying vehicles 200 of the swarm.
  • the luminous flying vehicles 200 of the swarm can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3- dimensional luminous display surfaces or canvases comprising a plurality of pixels.
  • FIG. 8A is a flow diagram of a method 800 of controlling a 3-dimensional pixel array system, in accordance with embodiments of the present inventive concepts.
  • a control system 300 may be configured according to a hybrid localization scheme, for example, as described above with reference to FIG. 3C.
  • the control system 300 may be provided with a control application 805 that configures the control system 300 to communicate with one or more optical motion capture systems 160 and/or one or more luminous flying vehicles 200 of a swarm.
  • the control system 300 may be configured to perform an initialization of the one or more optical motion capture systems 160 connected to the control system 300 and/or the one or more I/O devices 310 (e.g., wireless transceivers) of the control system 300 (810).
  • I/O devices 310 e.g., wireless transceivers
  • a synchronization of the luminous flying vehicles 200 of the swarm may be performed (815).
  • the control system 300 may be configured to transmit a synchronization packet to the luminous flying vehicles 200 of the swarm.
  • the control system 300 may be configured to continuously transmit trajectory and color data to the luminous flying vehicles 200 of the swarm (820, 825). However, in some embodiments the trajectory and color data may be transmitted to and stored on board the luminous flying vehicles 200 of the swarm prior to commencing a performance or event.
  • FIG. 8B is a flow diagram of a method of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts.
  • a luminous flying vehicle 200 may be configured according to a hybrid localization scheme, as described above with reference to FIG. 3C.
  • the luminous flying vehicle 200 of the swarm may be configured to commence an initialization procedure upon power-up (830). For example, a basic initialization and configuration of the micro-controllers 341 of the luminous flying vehicles 200 of the swarm may be performed. In addition, other devices of the luminous flying vehicles 200, such as wireless transceivers 244 (835) and/or positioning and localization systems 243 may be initialized during the initialization procedure (840).
  • the luminous flying vehicles 200 of the swarm may further be configured to undergo a zero heading calibration routine, which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (845).
  • a zero heading calibration routine which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (845).
  • each of the luminous flying vehicles 200 of the swarm may be positioned in an orientation that is to be defined as the default or zero heading orientation while positioning and localization systems 243 of each of the luminous flying vehicles 200 calibrate.
  • the luminous flying vehicles 200 of the swarm may be configured to commence performance of a luminous flying sequence or event (850). During performance of a luminous flying sequence or event, the luminous flying vehicles 200 may be configured to access data from the positioning and localization systems 243 (865, 870) and/or generate control commands (860) at a predetermined, fixed frequency (855, 856, 857).
  • the luminous flying vehicles 200 of the swarm may further be configured to transmit and receive data from other luminous flying vehicles 200 of the swarm and/or a control system 300 (875).
  • the luminous flying vehicles 200 of the swarm may further be configured to update the color and intensity of the one or more luminous elements 230 of each of the luminous flying vehicles 200 of the swarm.
  • FIGs. 9A-9C illustrate 3-dimensional luminous pixel arrays in accordance with embodiments of the present inventive concepts.
  • 3-dimensional luminous pixel arrays and 3-dimensional luminous pixel array systems can be configured and/or controlled to create and render 2-dimensional and 3-dimensional images and shapes that can move in space.
  • FIG. 9A illustrates a swarm of luminous flying vehicles arranged in space.
  • the swarm of luminous flying vehicles is arranged in space such that a free-form display is shown.
  • FIG. 9B illustrates a swarm of luminous flying vehicles arranged in space.
  • the swarm of luminous flying vehicles is arranged in space such that a raster image is shown.
  • FIG. 9C illustrates a swarm of luminous flying vehicles arranged in space.
  • the swarm of luminous flying vehicles is arranged in space such that a vector display is shown.

Abstract

A luminous pixel array includes a plurality of luminous flying vehicles configured to move in 3-dimensional space. A first luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one pixel of the luminous pixel array. The first luminous flying vehicle is configured to radiate a first color and intensity of light.

Description

3-D LUMINOUS PIXEL ARRAYS, 3-D LUMINOUS PD EL ARRAY CONTROL SYSTEMS AND METHODS OF CONTROLLING 3-D LUMINOUS PDCEL ARRAYS
TECHNICAL FIELD
The present inventive concepts generally relate to systems and methods for displaying
3-dimensional arrays of pixels, and more particularly, to 3-dimensional luminous pixel arrays, 3-dimensional luminous pixel array control systems and methods of controlling 3- dimensional luminous pixel arrays.
BACKGROUND
In general, 3-dimensional display devices comprise membranes or films that project an illusion of depth in a photograph, movie or other 2-dimensional image. A 3-dimensional illusion can be projected to a viewer by displaying two 2-dimensional images, which represent two perspectives of the same photograph, movie or image. However, such 3- dimensional display devices generally require viewers to wear specialized eyeglasses.
On the other hand, some 3-dimensional projection devices, such as swept- volume displays, comprise a plurality of image projectors that project images on a display surface undergoing rotational motion. As the display surface rotates, the images projected on the 2- dimensional display surface changes, which creates a 3-dimensional illusion. However, such 3-dimensional projection devices have limited viewing angles.
SUMMARY
The present inventive concepts generally relate to systems and methods for displaying 3-dimensional arrays of pixels, and more particularly, to 3-dimensional luminous pixel arrays, 3-dimensional luminous pixel array control systems and methods of controlling 3- dimensional luminous pixel arrays. In particular, embodiments described herein provide systems and methods for displaying and controlling 3-dimensional luminous pixel arrays that include a plurality of pixels, such as "flying pixels" or luminous flying vehicles, which move in 2-dimensional and 3-dimensional space. Each flying pixel or luminous flying vehicle can be configured and/or controlled to move in 2-dimensional and/or 3-dimensional space, e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc., and can be configured and/or controlled to change its color and light intensity so as to create and/or render 2-dimensional and 3-dimensional images and shapes that can move in space.
MIT-14079PCT 1 Further, embodiments described herein provide systems and methods for displaying and controlling 2-dimensional and 3-dimensional image-creating events. For example, a plurality of flying pixels or luminous flying vehicles can be configured and/or controlled to execute synchronized motions in space to form a luminous display surface or canvas comprising a plurality of pixels. As such, the plurality of flying pixels or luminous flying devices can be arranged in space to form various 2-dimensional and 3-dimensional images and shapes. In addition, unlike conventional 2-dimensional and 3-dimensional display devices that can only be viewed from a few directions, the systems and methods described herein can be viewed from all directions.
In one aspect, a luminous pixel array, comprises: a plurality of luminous flying vehicles configured to move in 3-dimensional space, wherein a first luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one pixel of the luminous pixel array, and wherein the first luminous flying vehicle is configured to radiate a first color and intensity of light.
The at least one pixel of the luminous pixel array may include a first pixel. The at least one pixel of the luminous pixel array may further include a second pixel. Each one of the plurality of luminous flying vehicles may correspond to a pixel of the luminous pixel array. Each one of the plurality of luminous flying vehicles may correspond to one or more pixels of the luminous pixel array.
The first luminous flying vehicle may include at least one luminous element constructed and arranged to radiate the first color and intensity of light. The at least one luminous element may include an RGB light emitting diode. The at least one luminous element may include a red light emitting diode, a green light emitting diode and a blue light emitting diode. The at least one luminous element may include one selected from the group consisting of: an electron stimulated device, an incandescent lamp device, an
electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device. The at least one luminous element may include an electronic display device.
A second luminous flying vehicle of the plurality of luminous flying vehicles may correspond to at least one other pixel of the luminous pixel array. The second luminous flying vehicle may include at least one luminous element constructed and arranged to radiate a second color and intensity of light. The at least one luminous element may include at least one light emitting diode. The at least one light emitting diode may include at least one phosphor-type light emitting diode or at least one organic light emitting diode.
MIT-14079PCT 2 The plurality of luminous flying vehicles may further be configured to move in 3- dimensional space so as to create 2-dimensional and 3 -dimensional shapes that can move in space. A color and intensity of light may be radiated by each of the plurality of luminous flying vehicles so as to render 2-dimensional and 3 -dimensional images.
The plurality of luminous flying vehicles may include second through twenty- fifth luminous flying vehicles. The plurality of luminous flying vehicles may include second through fiftieth luminous flying vehicles. The plurality of luminous flying vehicles may include second through one-hundredth luminous flying vehicles. The plurality of luminous flying vehicles may include second through one-thousandth luminous flying vehicles. The plurality of luminous flying vehicles may include second through two-thousandth luminous flying vehicles. The plurality of luminous flying vehicles may include second through five- thousandth luminous flying vehicles.
The plurality of luminous flying vehicles may include at least two rotary- wing luminous flying vehicles. The plurality of luminous flying vehicles may include at least two fixed- wing luminous flying vehicles. The plurality of luminous flying vehicles may include at least two aerostat luminous flying vehicles.
The first luminous flying vehicle may be configured to radiate the first color and intensity of light for a first predetermined length of time, and may be further configured to radiate a second color and intensity of light for a second predetermined length of time.
The first luminous flying vehicle may include an optical identification element that emits radiation in a non- visible spectrum. The optical identification element may include an infrared light emitting diode and/or a reflector. Each luminous flying vehicle of the plurality of luminous flying vehicles may include an optical identification element. The optical identification element may be constructed and arranged to emit radiation in a non-visible spectrum.
The first luminous flying vehicle may include at least one luminous element positioned on an outer surface of the first luminous flying vehicle. The at least one luminous element may be positioned on the outer surface of a body of the luminous flying vehicle. The at least one luminous element may be positioned on the outer surface of a gas chamber of the luminous flying device. The first luminous flying vehicle may include at least one luminous element positioned within a body of the first luminous flying vehicle. The at least one luminous element may be positioned within a central portion of the body. The body of the first luminous flying vehicle may be translucent or opaque.
MIT-14079PCT 3 The first luminous flying vehicle may include a vehicle control system comprising: a micro-processing system; positioning and localization systems electrically connected to the micro-processing system; at least one luminous element electrically connected to the microprocessing system; a wireless transceiver connected to the micro-processing system; and a power source constructed and arranged to provide a current to the micro-processing system, the positioning and localization systems, the at least one luminous element and the wireless transceiver. The micro-processing system may be configured to control a flight trajectory of the first luminous flying vehicle. The micro-processing system may be further configured to control a color and light intensity of the at least one luminous element. The micro-processing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to control commands received from a ground-based control system. The micro-processing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to a predetermined flight trajectory stored in memory of the vehicle control system.
The positioning and localization systems may include a navigation positioning system receiver configured to determine a position of the first luminous flying vehicle. The microprocessing system may be further configured to alter the flight trajectory of the first luminous flying vehicle in response to the position of the first luminous flying vehicle.
In another aspect, a luminous pixel array system, comprises: at least one luminous flying vehicle, the at least one luminous flying vehicle corresponding to at least one pixel of a luminous pixel array; and a control system configured to wirelessly communicate with the at least one luminous flying vehicle.
The at least one luminous flying vehicle may include a plurality of luminous flying vehicles. Two luminous flying vehicles of the plurality of luminous flying vehicles may include one selected from the group consisting of: rotary-wing luminous flying vehicles, fixed-wing luminous flying vehicles and aerostat luminous flying vehicles.
The at least one luminous flying vehicle may include at least one luminous element constructed and arranged to emit radiation in the visible spectrum. The at least one luminous element may include one selected form the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device.
The luminous pixel array system may further include an optical motion capture system configured to transmit captured images of the at least one luminous flying vehicle to the control system. The optical motion capture system may include at least one infrared
MIT-14079PCT 4 image capturing device. The optical motion capture system may include at least one optical image capturing device. The control system may be configured to reconstruct the spatial position of the at least one luminous flying vehicle based on the captured images. The control system may be further configured to determine a position and trajectory of the at least one luminous vehicle based on the captured images. The control system may be further configured to compute control commands based on a predetermined image-creating event stored in memory of the control system. The control commands may be transmitted by the control system to the at least one luminous flying vehicle. A vehicle control system of the luminous flying vehicle may alter at least one of a flight trajectory and a luminous element color and intensity according to the control commands received from the control system. The predetermined image-creating event may include at least one of flight trajectory data and image/sequence data. The flight trajectory data may include a plurality of desired spatial positions for the at least one luminous flying vehicle as a function of time. The flight trajectory data may include a mathematical function describing a geometry of a flight trajectory of the at least one luminous flying vehicle as a function of time. The
image/sequence data may include a plurality of luminous element color and intensity values for the at least one luminous flying vehicle as a function of time.
The control system may be configured to transmit the control commands to the at least one luminous flying vehicle. The at least one luminous flying vehicle may execute synchronized motions in space corresponding to control commands received from the control system.
The optical motion capture system may be configured to transmit the captured images of the at least one luminous flying vehicle to the control system via at least one of a wired communication line and a wireless communication link. The control system may include a memory device having a predetermined image-creating event stored therein. The control system may be configured to preprogram the at least one luminous flying vehicle with a predetermined flight trajectory and image/sequence. The at least one luminous flying vehicle may execute the image-creating event in response to the preprogramming of the
predetermined flight trajectory and image/sequence.
The control system may be further configured to transmit initialization and synchronization signals to the at least one luminous flying vehicle so as to coordinate the commencement and execution of the predetermined image-creating event by the at least one luminous flying vehicle.
MIT-14079PCT 5 The at least one luminous flying vehicle may include a plurality of luminous flying vehicles.
In another aspect, A luminous pixel array, comprises: a plurality of luminous flying vehicles arrange in 3 -dimensional space, wherein each luminous flying vehicle corresponds to at least one pixel of the luminous pixel array, and wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum.
The plurality of luminous flying vehicles may be arranged in space so as to form a 2- dimensional canvas in space. Each of the plurality of luminous flying vehicles may be configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to render first and second 2-dimensional images in space. The plurality of luminous flying vehicles may be suspended in space. The plurality of luminous flying vehicles may be airborne. The plurality of luminous flying vehicles may be arranged in space so as to form a 3 -dimensional shape in space. Each of the plurality of luminous flying vehicles may be configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to create first and second 3 -dimensional shapes in space.
BRIEF DESCRIPTION OF THE DRAWINGS
The foregoing and other objects, features and advantages of embodiments of the present inventive concepts will be apparent from the more particular description of preferred embodiments, as illustrated in the accompanying drawings in which like reference characters refer to the same elements throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the preferred embodiments.
FIG. 1 is an architectural view of 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts;
FIGs. 2A-2D illustrate luminous flying vehicles in accordance with embodiments of the present inventive concepts;
FIG. 2E is a block diagram of a control circuit of a luminous flying vehicle in accordance with embodiments of the present inventive concepts;
FIG. 3A illustrates a centralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts;
MIT-14079PCT 6 FIG. 3B illustrates a decentralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts;
FIG. 3C illustrates a hybrid localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts;
FIG. 4 A is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts;
FIG. 4B is a block diagram of a 3-dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts;
FIG. 5A is a block diagram of a centralized localization control system and method of controlling a 3-dimensional luminous pixel array in accordance with embodiments of the present inventive concepts;
FIG. 5B is a block diagram of a decentralized localization control system and method of controlling a 3-dimensional luminous pixel array in accordance with embodiments of the present inventive concepts;
FIGs. 6A and 6B are block diagrams illustrating luminous flying vehicle control systems in accordance with embodiments of the present inventive concepts;
FIGs. 7A, 7B, 8A and 8B are flow diagrams illustrating methods of controlling luminous flying vehicles in accordance with embodiments of the present inventive concepts;
FIGs. 9A-9C illustrate 3-dimensional luminous pixel arrays in accordance with embodiments of the present inventive concepts.
DETAILED DESCRIPTION OF EMBODIMENTS
The terminology used herein is for the purpose of describing particular embodiments and is not intended to be limiting of the inventive concepts. As used herein, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises,"
"comprising," "includes" and/or "including," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It will be understood that, although the terms first, second, third etc. may be used herein to describe various limitations, elements, components, regions, layers and/or sections,
MIT-14079PCT 7 these limitations, elements, components, regions, layers and/or sections should not be limited by these terms. These terms are only used to distinguish one limitation, element, component, region, layer or section from another limitation, element, component, region, layer or section. Thus, a first limitation, element, component, region, layer or section discussed below could be termed a second limitation, element, component, region, layer or section without departing from the teachings of the present application.
It will be further understood that when an element is referred to as being "on" or "connected" or "coupled" to another element, it can be directly on or above, or connected or coupled to, the other element or intervening elements can be present. In contrast, when an element is referred to as being "directly on" or "directly connected" or "directly coupled" to another element, there are no intervening elements present. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., "between" versus "directly between," "adjacent" versus "directly adjacent," etc.). When an element is referred to herein as being "over" another element, it can be over or under the other element, and either directly coupled to the other element, or intervening elements may be present, or the elements may be spaced apart by a void or gap.
FIG. 1 is an architectural view of 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts. A 3 -dimensional pixel array system 100 can comprise a plurality of luminous flying vehicles 200, a control system 300, at least one of a navigation positioning system 150 and/or a motion capture system 160 such as an optical motion capture system.
In some embodiments, the 3 -dimensional pixel array system 100 can comprise two or more luminous flying vehicles 200; however, in other embodiments, the 3 -dimensional pixel array system 100 can comprise a single luminous flying vehicle 200.
In some embodiments, each luminous flying vehicle 200 corresponds to single pixel of a 3 -dimensional pixel array. However, in other embodiments, each luminous flying vehicle 200 can correspond to two or more pixels of a 3 -dimensional pixel array. For example, in some embodiments, each luminous flying vehicle 200 can comprise two or more luminous elements 230, such as the luminous flying vehicle 200 illustrated in FIG. 2 A. As such, a luminous flying vehicle 200 having two or more luminous elements 230 can be configured to operate as a single pixel, wherein each of the two or more luminous elements 230 operate in unison, or can be configured to operate as two or more pixels, wherein each of the two or more luminous elements 230 operate independently of one another. In other embodiments, each luminous flying vehicle 200 can comprise a single luminous element 230.
MIT-14079PCT 8 In some embodiments, each luminous flying vehicle 200 can comprise a space-based global navigation satellite system receiver, such as a Global Positioning System (GPS) receiver and/or a Galileo Satellite Navigation receiver that can be configured to receive broadcast signals from one or more navigation positioning systems 150, such as GPS satellites and/or Galileo satellites.
In some embodiments, each luminous flying vehicle 200 can comprise an earth-based global navigation satellite system receiver, such as an emulated Global Positioning System (eGPS) receiver, that can be configured to receive broadcast signals from one or more navigation positioning systems 150, such as eGPS systems. An eGPS may include one or more beacons that are configured to emit signals similar to those emitted by GPS satellites and/or Galileo satellites. The one or more beacons can be arranged about a periphery of an operating volume to emit emulated positioning signals. For example, these beacons of an eGPS may be arranged in areas where conventional GPS and/or Galileo positioning signals are weak or non-existent, which can occur when there is an obstructed line of sight to one or more GPS or Galileo satellites.
Accordingly, luminous flying vehicles 200 having satellite system receivers can determine their position in space on-board. That is, each luminous flying vehicle 200 having a satellite system receiver can independently determine its position in space without the aid of the control system 300. Further, in some embodiments, the luminous flying vehicles 200 having satellite system receivers can be configured to transmit their position in space to the control system 300 and/or to one or more other luminous flying vehicles 200.
Referring to FIG. 1, the luminous flying vehicles 200 can be controlled via a control system 300, such as a server cluster, a computer system or other type of electronic control system. The control system 300 can comprise a wireless transceiver 310 that is configured to transmit control data to the two or more luminous flying vehicles 200. In some embodiments, the control system 300 and/or the wireless transceiver 310 is/are configured to broadcast control data packets to each of the two or more luminous flying vehicles 200. In other embodiments, the control system 300 and/or the wireless transceiver 310 is/are configured to multicast control data packets to one or more luminous flying vehicles 200. In other embodiments, the control system 300 and/or the wireless transceiver 310 is/are configured to unicast control data packets to one of the luminous flying vehicles 200. In some
embodiments, the control system and/or wireless transceiver 310 is/are configured to receive vehicle data from one or more of the luminous flying vehicles 200.
MIT-14079PCT 9 The control commands transmitted by the control system 300 can comprise at least one of position data (e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.), flight and trajectory data (e.g., direction and speed of flight) and image data (e.g., luminous element color and intensity) for one or more luminous flying vehicles 200.
The vehicle data transmitted to the control system 300 can comprise at least one of GPS position data, RSSI position data, flight and trajectory data, and system diagnostic data (e.g., system health, battery charge, etc.).
For purpose of the present disclosure, the terms "transmit", "transmitted" and
"transmitting" as used herein includes various types data packet routing and distribution schemes, including but not limited to: anycast schemes, broadcast schemes, multicast schemes and unicast schemes.
In some embodiments, the control system 300 can comprises a motion capture system 160 such as an optical motion capture system. In one embodiment, the optical motion capture system can comprise one or more image capturing devices or infrared (IR) cameras. The motion capture system 160 can be configured to track the position of one or more luminous flying devices 200 by capturing one or more images of the luminous flying vehicles 200, and allows the control system 300 to reconstruct the spatial position of the one or more luminous flying vehicles 200.
The motion capture system 160 may include a digital optical motion capture system, such as a Vicon optical motion capture system by Vicon Motion Systems of Centennial, CO, USA, a division of OMG pic of Oxford, UK or a optical motion capture system by
NaturalPoint, Inc. of Corvallis, OR, USA.
In some embodiments, the motion capture system 160 may include at least three cameras positioned about an operating volume so that each luminous flying vehicle 200 of the system 100 is visible by at least there cameras of the system 100. The control system 300 may reconstruct the spatial position of the luminous flying vehicles 200 based on the images captured by the cameras of the motion capture system 160.
FIGs. 2A-2D illustrate luminous flying vehicles in accordance with exemplary embodiments of the present inventive concepts. Luminous flying vehicles 200, such as fixed- wing luminous flying vehicles 270, rotary-wing luminous flying vehicles 280 and aerostat luminous flying vehicles 290, can comprise control circuitry 201 (see for example, FIG. 2E) including one or more luminous elements 230, 230a-d and an optional optical identification element 231.
MIT-14079PCT 10 Referring to FIGs. 2A and 2C, generally, rotary-wing luminous flying vehicles 280 are heavier-than-air flying machines that use lift generated by wings, such as rotor blades, that revolve around a body to achieve flight.
Referring to FIG. 2B, generally, fixed-wing luminous flying vehicles 270 are heavier- than-air flying machines that use forward motion to generate lift via wings mounted to a body to achieve flight.
Referring to FIG. 2D, generally, aerostat luminous flying vehicles 290 are lighter- than-air flying machines that achieve flight primarily through the use of buoyant lighter-than- air gases housed in a chamber.
Referring back to FIGs. 2A-2D, the luminous flying vehicles 200 described herein can comprise varying amounts of luminous elements 230. For example, in some embodiments, each luminous flying vehicle 200 can comprise one or more luminous elements 230. In some embodiments, each luminous flying vehicle 200 can comprise two or more luminous elements 230 that can be configured to operate in sequence so as to form a single pixel. In some embodiments, each luminous flying vehicle 200 can comprise two or more luminous elements 230 that can be configured to operate independently of one another so as to form two or more pixels.
The luminous elements 230 can comprise one or more electric powered luminous devices, such as electron stimulated devices, incandescent lamp devices, electroluminescent lamp devices, gas discharge lamp devices and high-intensity discharge lamp devices.
Examples of electron stimulated devices include electron stimulated luminescence (ESL) light bulbs and cathode ray tub (CRT) devices. Examples of electroluminescent lamps include light-emitting diodes (LEDs), such as organic LEDs, polymer LEDs, solid-state lighting, LED lamps, electroluminescent sheets and electroluminescent wires. Examples of gas discharge lamp devices include fluorescent lamps, compact fluorescent lamps (CFLs), neon and argon lamps, plasma lamps and xenon flash lamps. Examples of high-intensity discharge lamp devices include carbon arc lamps, ceramic discharge metal halide lamps, hydrargyrum medium-arc iodide lamps, mercury- vapor lamps, metal halide lamps, sodium vapor lamps and xenon arc lamps.
The luminous elements 230 can further comprise electronic display devices such as
LED displays, electroluminescent displays (ELDs), plasma display panels (PDPs), liquid crystal displays (LCDs), thin-film transistor displays (TFTs), organic light-emitting diode displays (OLEDs) and surface-conduction electron-emitter displays (SEDs).
MIT-14079PCT 11 The optional optical identification element 231 can comprise one or more infrared light-emitting diodes (IRLEDs), which, in some embodiments, can be tracked via the optical motion capture system 160 of the control system 300. In other embodiments, the optical identification element 231 may include a reflector that reflects a predetermined spectrum of light. For example, in embodiments where the optical identification element 231 includes a reflector, the system 100 may further include one or more light sources 161 that illuminate the operating volume with the predetermined spectrum of light, such as infrared light (see light sources 161 illustrated in FIG. 1). Accordingly, luminous flying vehicles 200 within the operating volume may reflect the light emitted by the one or more lights sources, which in turn can be captured by the optical motion capture system 160.
Referring to FIG. 2A, a luminous flying vehicle 200, such as a rotary-wing luminous flying vehicle 280, can comprise a main body 220 and one or more propellers 210. For example, the rotary-wing luminous flying vehicle 280 can comprise a quad-rotor helicopter design having first through fourth propellers 211-214 mounted vertically with respect to the main body 220 so as to provide lift and stability control. The rotary-wing luminous flying vehicles 280 can be controlled in all axes of space.
In this exemplary embodiment, the rotary- wing luminous flying vehicle 280 comprises a plurality of luminous elements 230, 230a-d positioned on sides of the main body 220 of the rotary-wing luminous flying vehicle 280. In addition, an optional optical identification element 231 is shown positioned on a lower portion of the main body 220 of the rotary-wing luminous flying vehicle 280. However, in other embodiments, the luminous elements 230, 230a-d can be positioned within a central portion of the main body 220 of the rotary- wing luminous flying vehicle 280. The luminous elements 230, 230a-d can emit light from outer surfaces of a translucent or opaque main body 220. That is, in some embodiments, the luminous elements 230, 230a-d can emit light from the entire circumference CR (i.e., 360°) of the main body 220 of the rotary- wing luminous flying vehicle 280.
Referring to FIG. 2B, a luminous flying vehicle 200, such as a fixed-wing luminous flying vehicle 270, can comprise a main body 220 and wings 210. In this exemplary embodiment, the fixed- wing luminous flying vehicle 280 comprises a plurality of luminous elements 230 positioned on the wings 210 and/or main body 220 of the vehicle 270. In addition, an optional optical identification element 231 is shown positioned on a lower portion of the main body 220.
Referring to FIG. 2C, a luminous flying vehicle 200, such as a rotary-wing luminous flying vehicle 280, can comprise a main body 220 and one or more propellers 210. For
MIT-14079PCT 12 example, the rotary- wing luminous flying vehicle 280 can comprise a dual-rotor helicopter design having first and second propellers 211-212 so as to provide lift and stability control.
In this exemplary embodiment, the rotary-wing luminous flying vehicle 280 comprises a plurality of luminous elements 230, positioned on sides of the main body 220 and/or lower rails of the main body 220. In addition, an optional optical identification element 231 is shown positioned on a lower portion of the main body 220 of the rotary-wing luminous flying vehicle 280.
Referring to FIG. 2D, a luminous flying vehicle 200, such as aerostat luminous flying vehicle 290, can comprise a main body 220 and a gas chamber 221. In this exemplary embodiment, the aerostat luminous flying vehicle 280 comprises a plurality of luminous elements 230, positioned on sides of the main body 220 and/or sides of the gas chamber 221. In one embodiment, the luminous element(s) 230 positioned on the sides of the gas chamber 221 can comprise, for example, a multi-pixel display device or panel.
FIG. 2E is a block diagram of a control system of a luminous flying vehicle in accordance with embodiments of the present inventive concepts. A vehicle control system 201 can comprise a micro-processing system 241, positioning and localization systems 243, luminous elements 230, optional optical identification elements 231, wireless transceivers 244, flight control systems 242 and a power source 240. Some elements having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
The micro-processing system 241 can comprise one or more processors that are capable of communicating with and controlling the positioning and localization systems 243, the luminous elements 230, the optical identification elements 231, the wireless transceivers 244 and the flight control systems 242 of the vehicle control system 201. In this manner, the micro-processing system 241 can control the flight path of the luminous flying vehicle 200, along with the color and/or light intensity of the luminous elements 230 positioned thereon.
In some embodiments, the positioning and localization systems 243 can comprise a 3- axis accelerometer, a gyroscope, a magnetometer and a navigation positioning system receiver, and can communicate positioning and localization data and/or vehicle data to the micro-processing system 241. In some embodiments, the micro-processing system 241 can configure the wireless transceiver 244 to transmit vehicle data to the control system 300 and/or other luminous flying vehicles 200.
The positioning and localization systems 243 may be configured to determine a position of the luminous flying vehicle 200 via one or more of the following positioning
MIT-14079PCT 13 systems: GPS, eGPS, Ultrasonic receiver systems and received signal strength indicator (RSSI) systems.
For example, positioning and localization systems 243 including ultrasonic receiver systems may include an ultrasonic receiver configured to receive ultrasonic chirps from a plurality of ultrasonic transmitters placed about an operating volume. Ultrasonic transmitters, having known positions, can be configured to successively emit ultrasonic chirps with a time delay between the chirps of different transmitters. A synchronization event prior to the emission of a sequence of chirps may allow the ultrasonic receiver system to calculate time of flight information so that a position of the luminous flying vehicle 200 can be determined.
Positioning and localization systems 243 including RSSI systems can include a radio transceiver configured to determine radio signal strength of a signal emitted by a radio transceiver of another luminous flying vehicle 200. The signal strength can then be used to estimate the distance to a radio transmitter. In addition, the system 100 may include several identifiable transmitters positioned about the operating volume to allow the receivers to triangulate their positions in 3D space. In some embodiments, the RSSI system can be included within the wireless transceiver 233 (e.g., ZigBee transceivers).
The wireless transceiver 244 can comprise a wireless sensor network transceiver, such as a ZigBee transceiver, a EnOcean transceiver, Personal area network transceiver, a
Bluetooth transceiver, a TransferJet transceiver and/or an Ultra-wideband transceiver, and can further comprise a wireless network transceiver, such as a Wireless LAN (WLAN) transceiver (e.g., IEEE 802.11, WiFi) and/or a Broadband Fixed Access (BWA) transceiver (e.g., LMDS, WiMAX). In some embodiments, the wireless transceiver 244 can be configured to communicate with one or more wireless transceivers 244 of other luminous flying vehicles 200 and/or with a wireless transceiver 310 of a control system 300.
The flight controls 242 can comprise various motor drivers, actuating systems and control devices that are associated with the flight control of the luminous flying vehicles 200 described herein.
The power source 240 can comprise one or more batteries configured to provide electrical power to the systems, devices and elements of the vehicle control system 201.
FIGs. 3A-3C illustrate various systems and methods of controlling a 3-dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts. A 3-dimensional luminous pixel array system can comprise a plurality of luminous flying vehicles 200, 200a-d and an optional vehicle charging station 400. Some elements
MIT-14079PCT 14 having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
The optional vehicle charging station 400 can be provided with a 3 -dimensional luminous pixel array system. The vehicle charging station 400 can be constructed and arranged to charge the power source 240 of one or more of the luminous flying vehicles 200, 200a-d. In some embodiments, the vehicle charging station 400 is constructed and arranged to provide a charging current to one or more of the luminous flying vehicles 200, 200a-d via a wired connection. In some embodiments, the vehicle charging station 400 is constructed and arranged to provide a charging current to one or more of the luminous flying vehicles 200, 200a-d via a wireless connection (e.g., induction charging).
A 3-dimensional luminous pixel array system can comprise a single flying pixel or luminous flying vehicle, or can comprise any number of flying pixels or luminous flying vehicles. In some embodiments, a 3-dimensional luminous pixel array system can comprise at least 25 flying pixels or luminous flying vehicles 200. In some embodiments, a 3- dimensional luminous pixel array system can comprise at least 50 flying pixels or luminous flying vehicles 200. In some embodiments, a 3-dimensional luminous pixel array system can comprise at least 100 flying pixels or luminous flying vehicles 200. In some embodiments, a 3-dimensional luminous pixel array system can comprise at least 1000 flying pixels or luminous flying vehicles 200. In some embodiments, a 3-dimensional luminous pixel array system can comprise at least 2000 flying pixels or luminous flying vehicles 200. In some embodiments, a 3-dimensional luminous pixel array system can comprise at least 5000 flying pixels or luminous flying vehicles 200.
For the purpose of the present description, the terms "centralized localization" and "off-board localization" as used herein relate to systems and methods for controlling a 3- dimensional luminous pixel array wherein the position of each luminous flying vehicle is determined by one or more systems, devices or elements that are separate from each luminous flying device.
For the purpose of the present description, the terms "decentralized localization" and "on-board localization" as used herein relate to systems and methods for controlling a 3- dimensional luminous pixel array wherein the position of each luminous flying vehicle is determined by one or more systems, devices or elements that are part of each luminous flying device.
For the purpose of the present description, the term "hybrid localization" as used herein defines systems and methods for controlling a 3-dimensional luminous pixel array
MIT-14079PCT 15 wherein the position of each luminous flying vehicle is determined by one or more systems, devices or elements that are part of each luminous flying device and one or more systems, devices or elements that are separate from each luminous flying device.
FIG. 3A illustrates a centralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts. In a centralized localization scheme, the spatial positions of a plurality of luminous flying vehicles 200, 200a-c can be determined and/or tracked by an off-board system, such as a control system 300 having a motion capture system 160 such as an optical motion capture system (e.g., optical image/video capturing device) or an electromagnetic object detection system (e.g., radar devices and systems).
In this exemplary embodiment, the motion capture system 160 comprises one or more optical motion capture devices 160a-c, which can comprise image capturing devices such as infrared (IR) cameras. In some embodiments, a first motion capture device 160a is electrically connected to the control system 300 via a wired communication line 165a, and second and third motion capture devices 160b, 160c are wirelessly connected to the control system 300 via wireless communication links 165b, 165c; however, various other wired and wireless configurations are possible. For example, each motion capture device 160a-c can be connected to the control system 300 via one or more wired communication lines, or each motion capture device 160a-c can be wirelessly connected to the control system 300 via one or more wireless communication links.
The motion capture system 160 can be configured to track the positions of the plurality of luminous flying vehicles 200, 200a-c by capturing images of the swarm 250 of luminous flying vehicles 200, 200a-c. For example, in one embodiment, each luminous flying vehicle 200, 200a-c can be provided with an identification element 231, such as an infrared light-emitting diode, that can be tracked by the motion capture system 160. The identification element can emit radiation in a non-visible spectrum so as not to interfere with radiation emitted by the luminous elements 230 of the luminous flying vehicles 200. As a result, the control system 300 can reconstruct the spatial positions of each luminous flying vehicle 200, 200a-c of the swarm 250, and compute control commands to transmit to the plurality of luminous flying vehicles 200, 200a-c.
In some embodiments, IRLEDs of the optical identification elements 231 of each luminous vehicle can be configured to continuously emit radiation in a non- visible spectrum; however, in other embodiments, the IRLEDs may be configured to pulse in various different frequencies so as to emit vehicle identification pulses. The optical tracking systems 160 may
MIT-14079PCT 16 capture the radiation emitted by the IRLEDs, which can be output as a set of points in 3D corresponding to marker locations. The control system may be configured to update the position estimates for all of the luminous flying vehicles 200.
In embodiments where the IRLEDs continuously emit radiation, the identification of the luminous flying vehicles 200 can be based on a semi-manual initialization of a point- cloud. For example, this can be accomplished by arranging the luminous flying vehicles 200 in a set initialization arrangement, and labeling one or two of the luminous flying vehicles 200 manually in software and allowing the rest to be labeled automatically.
The control commands can be transmitted by the control system 300 via the wireless transceiver 310, and can comprise position data (e.g., Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc.), flight and trajectory data (e.g., direction and speed of flight) and image data (e.g., luminous element color and light intensity).
In this manner, the control system 300 can compute control commands to transmit to each of the luminous flying vehicles 200, 200a-c using, for example, a fixed control law that is dependent upon the type of vehicle and the on-board control software of each vehicle.
Accordingly, the plurality flying pixels or luminous flying vehicles 200, 200a-c can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3-dimensional luminous display surfaces or canvases comprising a plurality of pixels.
FIG. 3B illustrates a decentralized localization system and method of controlling a 3- dimensional luminous pixel array in accordance with embodiments of the present inventive concepts. In a decentralized localization scheme, the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by on-board systems of the luminous flying vehicles 200, 200a-d, such as vehicle control systems 201 having positioning and localization systems 243.
In this exemplary embodiment, a plurality of navigation positioning systems 150, 150a-b are provided, which can broadcast positioning signals to the luminous flying vehicles 200, 200a-d. The vehicle control systems 201 and/or the positioning and localization systems 243 of the vehicles 200, 200a-d can be configured to receive the positioning signals from one or more of the navigation positioning systems 150, 150a-b, and can be configured to determine the spatial position of each vehicle 200, 200a-d in response to the received positioning signals.
In this manner, the luminous flying vehicles 200, 200a-d can be configured to execute a flight trajectory in space, along with a sequence of image data commands (e.g., pixel color
MIT-14079PCT 17 and intensity). Accordingly, the plurality flying pixels or luminous flying vehicles 200, 200a- d can be configured and/or controlled to execute synchronized motions in space to form 2- dimensional and 3 -dimensional luminous display surfaces or canvases comprising a plurality of pixels.
In some embodiments, a control system 300 is provided, which can preprogram the luminous flying vehicles 200, 200a-d to execute a predetermined image-creating event. For example, a predetermined image-creating event can comprise a predetermined flight trajectory for each of the luminous flying vehicles 200, 200a-d and a predetermined sequence of image data commands for each of the luminous flying vehicles 200, 200a-d. In addition, in some embodiments, the control system 300 can transmit an initialization and
synchronization signal to each of luminous flying vehicles 200, 200a-d so as to synchronize the executing of the image-creating event.
In some embodiments, a control system 300 is provided, which can program the luminous flying vehicles 200, 200a-d to execute an image-creating event that can be updated from time to time, or in real-time. For example, an image-creating event can comprise a flight trajectory for each of the luminous flying vehicles 200, 200a-d and a sequence of image data commands for each of the luminous flying vehicles 200, 200a-d that can be updated by the control system 300. The control system 300 can be configured to transmit the updated image-creating event to each of the luminous flying vehicles 200, 200a-d.
FIG. 3C a hybrid localization system and method of controlling a 3 -dimensional luminous pixel array in accordance with embodiments of the present inventive concepts. In a hybrid localization scheme the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by both an off-board system, such as a control system 300 having a motion capture system 160 (described above with reference to FIG. 3 A) and an on-board system, such as vehicle control systems 201 having positioning and localization systems 243 (described above with reference to FIG. 3B).
FIG. 4 A is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts. A 3-dimensional luminous pixel array system can comprise a control system 300, an motion capture system 160 such as an optical motion capture system and a plurality of luminous flying vehicles 200, and can be configured in a centralized localization mode.
In a centralized localization mode, the control system 300 can configure the motion capture system 160 to capture images and/or position information of a swarm of luminous flying vehicles 200. In response to receiving the captured image data and/or position
MIT-14079PCT 18 information, the control system 300 can reconstruct the spatial positions of each luminous flying vehicle 200 of the swarm. As a result, the control system 300 can compute control commands, and can transmit the control commands to the swarm of luminous flying vehicles 200 so as to execute an image-creating event.
In this manner, the control system 300 can direct the execution of image-creating events by controlling the flight trajectory and position of each of the luminous flying vehicles 200 of the swarm, and can further control the pixel color and light intensity of each of the luminous flying vehicles 200 of the swarm.
FIG. 4B is a block diagram of a 3 -dimensional luminous pixel array system in accordance with embodiments of the present inventive concepts. A 3 -dimensional luminous pixel array system can comprise a control system 300, one or more navigation positioning systems 150 and a plurality of luminous flying vehicles 200, and can be configured in a decentralized localization mode.
In a decentralized localization mode, the control system 300 can be configured to transmit flight trajectory data and image sequence data to each of the luminous flying vehicles 200 of the swarm, and can be further configured to transmit an initialization and synchronization signal to the swarm of luminous flying vehicles 200. In some embodiments, flight trajectory data and image sequence data is preprogrammed in system memory of each of the luminous flying vehicles 200 of the swarm prior to commencement of the image- creating event; however, in some embodiments, flight trajectory data and image sequence data is transmitted before and during the execution of the image-creating event. In some embodiments, flight trajectory data and image sequence data is updated during the execution of the image-creating event.
Further, each of the luminous flying vehicles 200 of the swarm can be configured to determine its spatial position from positioning signals broadcast by the one or more navigation positing systems 150, and can be further configured to compute flight trajectory commands and image sequence commands based on its determined spatial position, and the flight trajectory data and the image sequence data received from the control system 300.
As a result, each of the luminous flying vehicles 200 of the swarm can be configured to execute an image-creating event according to flight trajectory data and a image sequence data, and can commence and execute the image-creating event in response to the initialization and synchronization signals transmitted by the control system 300.
FIG. 5A is a block diagram of a centralized localization control system and method for controlling a 3-dimensional luminous pixel array in accordance with embodiments of the
MIT-14079PCT 19 present inventive concepts. A control system 300 can be configured as a centralized localization control system, and can comprise a processor 301, an input/output (I/O) device 310, a memory device 320 and a wireless transceiver 244.
The memory device 320 can comprise random access memory (RAM), read only memory (ROM) or other type of memory device, and can be indirectly or directly connected to the processor 301. In some embodiments, the memory device can be integrated within the processor device 301.
The I/O device 310 can comprise various types of I/O devices known in the art, such as a universal serial bus (USB) interface device, a serial interface device (e.g., RS-232, 12C, SPI), a Firewire interface device (i.e., IEEE 1394) or a combination thereof.
In this exemplary embodiment, the motion capture system 160, described above with reference to FIGs. 3A and 5A, can transmit captured images and/or position data of a swarm of luminous flying vehicles 200 to the control system 300 via at least one of a wired communication line 165a connected to the I/O device 310 and a wireless communication link 165b/c with the wireless transceiver 244. In response to the received captured images and/or position data, the control system 300 can post-process the captured images and/or position data so that positions and trajectories of the luminous flying vehicles 200 of the swarm can be determined.
For example, the processor 301 can be configured to estimate the positions and trajectories of the luminous flying vehicles 200 of the swarm, and can compute control commands to be transmitted via the wireless transceiver 244 to each of the luminous flying vehicles 200 of the swarm. The control commands can comprise position data commands, such as Cartesian coordinates, polar coordinates, celestial coordinates, ecliptic coordinates, geographic coordinates, etc., flight data commands, such as direction and speed of flight, and image date commands, such as luminous element color and intensity for each of the luminous flying vehicles 200 of the swarm.
In some embodiments, the processor 301 can be configured to compute the control commands based on a predetermined image-creating event stored in the memory device 320 of the control system 300 or based on a variable image-creating event. For example, the image-creating event can comprise flight trajectory data 340 for each luminous flying vehicle 200 of the swarm and can comprise image/sequence data 350 for each luminous flying vehicle 200 of the swarm. In one embodiment, the flight trajectory data 340 can comprise the desired spatial position of each luminous flying vehicle 200 of the swarm as a function of time, and the image/sequence data 350 can comprise luminous element 230 color and
MIT-14079PCT 20 intensity for each flying vehicle 200 of the swarm as a function of time. In another embodiment, the flight trajectory data 340 can comprise a mathematical function describing the geometry of the flight trajectory for each flying vehicle 200 of the swarm.
Accordingly, the control system 300 can direct the execution of image-creating events by controlling the flight trajectory and position of each luminous flying vehicle 200 of the swarm, and can further control the pixel color and light intensity of each luminous flying vehicle 200 of the swarm. As such, the swarm of luminous flying vehicles can be configured and/or controlled to execute synchronized motions in space to form luminous display surfaces of varying shapes and colors.
FIG. 5B is a block diagram of a decentralized localization control system and method of controlling a 3 -Dimensional luminous pixel array in accordance with embodiments of the present inventive concepts. A control system 300 can be configured as a decentralized localization control system, and can comprise a processor 301, a memory device 320 and a wireless transceiver 244.
In this exemplary embodiment, the control system 300 can be configured to transmit flight trajectory data 340 and image sequence/data 350 stored in the memory device 320 to each of the luminous flying vehicles 200 of the swarm via the wireless transceiver 244. In some embodiments, the control system 300 is configured to preprogram each of the luminous flying vehicles 200 with flight trajectory data 340 and image/sequence data 350 prior to execution of an image-creating event. In some embodiments, the control system 300 is configured to transmit the flight trajectory data 340 and image sequence data 350 during the execution of an image-creating event.
In addition, the control system 300 can be further configured to transmit an initialization and synchronization signal to each of the luminous flying vehicles 200 of the swarm so as to coordinate the commencement and execution of an image-creating event.
Accordingly, the control system can transmit flight data and image/sequence data to each of the luminous flying vehicles 200 of the swarm, and can be configured to initialize an image-creating event by transmitting initialization and synchronization signals to the swarm of luminous flying vehicles 200.
FIGs. 6A and 6B are block diagrams illustrating luminous flying vehicle control systems in accordance with embodiments of the present inventive concepts. Some elements having the same functions as those described above are indicated by like reference identifiers, and thus their detailed description will not be repeated.
MIT-14079PCT 21 A control system 201 of a luminous flying vehicle 200 can comprise micro-processing system 241, positioning and localization systems 243, luminous elements 230, optional optical identification elements 231 , wireless transceivers 244, flight control systems 242, flight motors and actuating systems 245 and one or more power sources 240.
Referring to FIG. 6A, in a centralized localization scheme, the spatial positions of a plurality of luminous flying vehicles 200, 200a-c can be determined and/or tracked by an off- board system, such as a control system 300 having a motion capture system 160 such as an optical motion capture system (e.g., optical image/video capturing device) or an
electromagnetic object detection system (e.g., radar devices and systems). Accordingly, each of the plurality of luminous flying vehicles 200 may include an optical ID element, such as an IRLED and/or a reflector, which can emit radiation. This radiation can then be captured by a motion capture system 160, and positions of each of the luminous flying vehicles 200 can be determined and/or tracked by a control system 300. The control system 300 may then transmit control commands to each of the luminous flying vehicles 200 via wireless communication links.
Referring to FIG. 6B, in a decentralized localization scheme, the spatial positions of a plurality of luminous flying vehicles 200, 200a-d can be determined and/or tracked by onboard systems of the luminous flying vehicles 200, 200a-d, such as vehicle control systems 201 having positioning and localization systems 243. The positioning and localization systems 243 of each luminous flying vehicle 200 may include one or more subsystems 243 a-c, which can be selected from the group consisting of: a 3-axis accelerometer, a gyroscope, a magnetometer and a navigation positioning system receiver.
Accordingly, the luminous flying vehicles 200 can be configured to execute a flight trajectory in space, along with a sequence of image data commands (e.g., pixel color and intensity), which can be stored in system memory 255.
FIGs. 7A, 7B, 8A and 8B are flow diagrams illustrating methods of controlling a luminous flying vehicles, in accordance with embodiments of the present inventive concepts.
The methods described herein can be implemented by the systems and devices described herein, or equivalent systems, executing a unique set of instructions stored in system or device memory. As will be appreciated by those skilled in the art, a unique set of instructions can be implemented or embodied in software, firmware, or a combination thereof. As such, the unique set of instructions stored in system memory transform the systems and devices into particular, special purpose systems that can operate, for example, according to the following exemplary flow diagrams. In some embodiments, unique sets of instructions
MIT-14079PCT 22 correspond to the operations and methods described in connection with the following flow diagrams.
FIG. 7 A is a flow diagram of a method 700 of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts. A control system 300 may be configured according to a centralized localization scheme, for example, as described above with reference to FIGs. 3 A and 4A.
The control system 300 may be provided with an optical tracking application 705 that configures the control system 300 to communicate with one or more optical motion capture systems 160. The optical tracking application 705 may configure the control system 300 to perform an initialization of the one or more optical motion capture systems 160 connected to the control system 300 (710). Following initialization of the control system 300 and/or the one or more optical motion capture systems 160, the control system 300 may begin processing raw data, such as optical image data, received from the one or more optical motion capture systems 160 (715). The raw data may include optical images of a swarm of one or more luminous flying vehicles 200.
In response to the receiving to the raw data, the control system 300 may generate point clouds that represent the positions of one or more luminous vehicles 200 of a swarm (715). For example, the control system 300 may be configured to generate one or more sets of 3 -dimensional points corresponding to 3 -dimensional locations of the one or more luminous flying vehicles 200. The points may correspond to the location of transmission of optical identification elements 231 of each of the luminous flying vehicles 200 of the swarm. The control system 300 may be further configured to transmit the one or more sets of 3- dimensional points to one or more other control systems connected to the control system 300 (720). For example, the control system 300 may be configured to transmit the one or more sets of 3-dimensional points to one or more other control systems connected to the control system 300 via a wired or wireless network.
The control system 300 and/or another control system may be provided with a vehicle control application 725, which may be executed in parallel with the optical tracking application 705. The vehicle control application 725 may configure the control system 300 and/or other control system to compute positions, movements, image commands and/or other control signals that may be transmitted to the one or more luminous flying vehicles 200 of the swarm.
In a semi-manual initialization configuration, the control system 300 may require that each of the points of a point cloud be mapped with a luminous flying vehicle 200 of the
MIT-14079PCT 23 swarm (730). For example, a user of the control system 300 may map points of a point cloud with the luminous flying vehicles 200 of the swarm (735). However, in other embodiments the initial mapping of points of the point cloud may be fully automated by the control system 300.
The control system 300 may be further configured to estimate the positions of the luminous flying vehicles 200 of the swarm based on the one or more sets of 3 -dimensional points (745). The estimation of the positions of the luminous flying vehicles 200 may be further based on previous sets of 3 -dimensional points and/or dynamic models describing the behavior of the luminous flying vehicles 200.
The control system 300 may be configured to continuously estimate the positions of the luminous flying vehicles 200 of the swarm at a rate less then or equal to a rate of the generation of the sets of 3 -dimensional points. The control system 300 maybe further configured to generate vehicle trajectory and color command signals based on the estimated positions of the luminous flying vehicles 200 of the swarm (755). In some embodiments, the vehicle trajectory and color command signals are generated at a fixed frequency, which may be controlled according to a fixed control period (750). Following the generation of the vehicle trajectory and color command signals, the control system 300 may be configured to transmit the vehicle trajectory and color command signals to the luminous flying vehicles 200 of the swarm (760). In this manner, the luminous flying vehicles 200 can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3- dimensional luminous display surfaces or canvases comprising a plurality of pixels.
FIG. 7B is a flow diagram of a method 701 of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts. Luminous flying vehicles 200 of a swarm may be configured according to a decentralized localization scheme, for example, as described above with reference to FIGs. 3B and 4B.
The luminous flying vehicles 200 of a swarm may be configured to commence an initialization procedure upon power-up (765). For example, a basic initialization and configuration of the micro-controllers 341 of the luminous flying vehicles 200 of the swarm may be performed. In addition, other devices of the luminous flying vehicles 200, such as wireless transceivers 244 (770) and/or positioning and localization systems 243 may be initialized during the initialization procedure (775).
The luminous flying vehicles 200 of the swarm may further be configured to undergo a zero heading calibration routine, which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (780). For example, each of the
MIT-14079PCT 24 luminous flying vehicles 200 of the swarm may be positioned in an orientation that is to be defined as the default or zero heading orientation while positioning and localization systems 243 of each of the luminous flying vehicles 200 calibrate.
Following initialization and calibration routines, the luminous flying vehicles 200 of the swarm may be configured to commence performance of a luminous flying sequence or event (785). During performance of a luminous flying sequence or event, the luminous flying vehicles 200 may be configured to access data from the positioning and localization systems 243 (795) and/or generate control commands (790) at a predetermined, fixed frequency (786, 787).
The luminous flying vehicles 200 of the swarm may further be configured to transmit and receive data from other luminous flying vehicles 200 of the swarm and/or a control system 300 (799). The luminous flying vehicles 200 of the swarm may further be configured to update the color and intensity of the one or more luminous elements 230 of each of the luminous flying vehicles 200 of the swarm.
Accordingly, the luminous flying vehicles 200 of the swarm can be configured and/or controlled to execute synchronized motions in space to form 2-dimensional and 3- dimensional luminous display surfaces or canvases comprising a plurality of pixels.
FIG. 8A is a flow diagram of a method 800 of controlling a 3-dimensional pixel array system, in accordance with embodiments of the present inventive concepts. A control system 300 may be configured according to a hybrid localization scheme, for example, as described above with reference to FIG. 3C.
The control system 300 may be provided with a control application 805 that configures the control system 300 to communicate with one or more optical motion capture systems 160 and/or one or more luminous flying vehicles 200 of a swarm.
The control system 300 may be configured to perform an initialization of the one or more optical motion capture systems 160 connected to the control system 300 and/or the one or more I/O devices 310 (e.g., wireless transceivers) of the control system 300 (810).
Following initialization, a synchronization of the luminous flying vehicles 200 of the swarm may be performed (815). For example, the control system 300 may be configured to transmit a synchronization packet to the luminous flying vehicles 200 of the swarm.
The control system 300 may be configured to continuously transmit trajectory and color data to the luminous flying vehicles 200 of the swarm (820, 825). However, in some embodiments the trajectory and color data may be transmitted to and stored on board the luminous flying vehicles 200 of the swarm prior to commencing a performance or event.
MIT-14079PCT 25 FIG. 8B is a flow diagram of a method of controlling a 3 -dimensional pixel array system, in accordance with embodiments of the present inventive concepts. A luminous flying vehicle 200 may be configured according to a hybrid localization scheme, as described above with reference to FIG. 3C.
The luminous flying vehicle 200 of the swarm may be configured to commence an initialization procedure upon power-up (830). For example, a basic initialization and configuration of the micro-controllers 341 of the luminous flying vehicles 200 of the swarm may be performed. In addition, other devices of the luminous flying vehicles 200, such as wireless transceivers 244 (835) and/or positioning and localization systems 243 may be initialized during the initialization procedure (840).
The luminous flying vehicles 200 of the swarm may further be configured to undergo a zero heading calibration routine, which may define a default or zero heading orientation of each of the luminous flying vehicles 200 of the swarm (845). For example, each of the luminous flying vehicles 200 of the swarm may be positioned in an orientation that is to be defined as the default or zero heading orientation while positioning and localization systems 243 of each of the luminous flying vehicles 200 calibrate.
Following initialization and calibration routines, the luminous flying vehicles 200 of the swarm may be configured to commence performance of a luminous flying sequence or event (850). During performance of a luminous flying sequence or event, the luminous flying vehicles 200 may be configured to access data from the positioning and localization systems 243 (865, 870) and/or generate control commands (860) at a predetermined, fixed frequency (855, 856, 857).
The luminous flying vehicles 200 of the swarm may further be configured to transmit and receive data from other luminous flying vehicles 200 of the swarm and/or a control system 300 (875). The luminous flying vehicles 200 of the swarm may further be configured to update the color and intensity of the one or more luminous elements 230 of each of the luminous flying vehicles 200 of the swarm.
FIGs. 9A-9C illustrate 3-dimensional luminous pixel arrays in accordance with embodiments of the present inventive concepts. As described above, 3-dimensional luminous pixel arrays and 3-dimensional luminous pixel array systems can be configured and/or controlled to create and render 2-dimensional and 3-dimensional images and shapes that can move in space.
MIT-14079PCT 26 FIG. 9A illustrates a swarm of luminous flying vehicles arranged in space. In this exemplary illustration, the swarm of luminous flying vehicles is arranged in space such that a free-form display is shown.
FIG. 9B illustrates a swarm of luminous flying vehicles arranged in space. In this exemplary illustration, the swarm of luminous flying vehicles is arranged in space such that a raster image is shown.
FIG. 9C illustrates a swarm of luminous flying vehicles arranged in space. In this exemplary illustration, the swarm of luminous flying vehicles is arranged in space such that a vector display is shown.
While the present inventive concepts have been particularly shown and described above with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art, that various changes in form and detail can be made without departing from the spirit and scope of the present inventive concepts described and defined by the following claims.
MIT-14079PCT 27

Claims

What is claimed is:
1. A luminous pixel array, comprising:
a plurality of luminous flying vehicles configured to move in 3-dimensional space, wherein a first luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one pixel of the luminous pixel array, and
wherein the first luminous flying vehicle is configured to radiate a first color and intensity of light.
2. The luminous pixel array of claim 1 , wherein the at least one pixel of the luminous pixel array comprises a first pixel.
3. The luminous pixel array of claim 2, wherein the at least one pixel of the luminous pixel array further comprises a second pixel.
4. The luminous pixel array of claim 1, wherein each one of the plurality of luminous flying vehicles corresponds to a pixel of the luminous pixel array. 5. The luminous pixel array of claim 1, wherein each one of the plurality of luminous flying vehicles corresponds to one or more pixels of the luminous pixel array.
6. The luminous pixel array of claim 1 , wherein the first luminous flying vehicle comprises at least one luminous element constructed and arranged to radiate the first color and intensity of light.
7. The luminous pixel array of claim 6, wherein the at least one luminous element comprises an RGB light emitting diode.
8. The luminous pixel array of claim 6, wherein the at least one luminous element comprises a red light emitting diode, a green light emitting diode and a blue light emitting diode.
MIT-14079PCT 28
9. The luminous pixel array of claim 6, wherein the at least one luminous element comprises one selected from the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device.
10. The luminous pixel array of claim 6, wherein the at least one luminous element comprises an electronic display device.
11. The luminous pixel array of claim 1 , wherein a second luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one other pixel of the luminous pixel array.
12. The luminous pixel array of claim 11 , wherein the second luminous flying vehicle comprises at least one luminous element constructed and arranged to radiate a second color and intensity of light.
13. The luminous pixel array of claim 12, wherein the at least one luminous element comprises at least one light emitting diode. 14. The Luminous pixel array of claim 13, wherein the at least one light emitting diode comprises at least one phosphor-type light emitting diode or at least one organic light emitting diode.
15. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles are further configured to move in 3-dimensional space so as to create 2-dimensional and 3- dimensional shapes that can move in space.
16. The luminous pixel array of claim 15, wherein a color and intensity of light is radiated by each of the plurality of luminous flying vehicles so as to render 2-dimensional and 3- dimensional images.
17. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles comprises second through twenty- fifth luminous flying vehicles.
MIT-14079PCT 29
18. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles comprises second through fiftieth luminous flying vehicles.
19. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles comprises second through one-hundredth luminous flying vehicles.
20. The luminous pixel array of claim 1, wherein the plurality of luminous flying vehicles comprises second through one-thousandth luminous flying vehicles. 21. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles comprises second through two-thousandth luminous flying vehicles.
22. The luminous pixel array of claim 1, wherein the plurality of luminous flying vehicles comprises second through five-thousandth luminous flying vehicles.
23. The luminous pixel array of claim 1 , wherein the plurality of luminous flying vehicles comprises at least two rotary-wing luminous flying vehicles.
24. The luminous pixel array of claim 1, wherein the plurality of luminous flying vehicles comprises at least two fixed-wing luminous flying vehicles.
25. The luminous pixel array of claim 1, wherein the plurality of luminous flying vehicles comprises at least two aerostat luminous flying vehicles. 26. The luminous pixel array of claim 1, wherein the first luminous flying vehicle is configured to radiate the first color and intensity of light for a first predetermined length of time, and is further configured to radiate a second color and intensity of light for a second predetermined length of time. 27. The luminous pixel array of claim 1 , wherein the first luminous flying vehicle comprises an optical identification element that emits radiation in a non- visible spectrum.
28. The luminous pixel array of claim 27, wherein the optical identification element comprises an infrared light emitting diode.
MIT-14079PCT 30
29. The luminous pixel array of claim 1 , wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises an optical identification element.
30. The luminous pixel array of claim 29, wherein the optical identification element is constructed and arranged to emit radiation in a non-visible spectrum.
31. The luminous pixel array of claim 1 , wherein the first luminous flying vehicle comprises at least one luminous element positioned on an outer surface of the first luminous flying vehicle.
32. The luminous pixel array of claim 31 , wherein the at least one luminous element is positioned on the outer surface of a body of the luminous flying vehicle.
33. The luminous pixel array of claim 31 , wherein the at least one luminous element is positioned on the outer surface of a gas chamber of the luminous flying device.
34. The luminous pixel array of claim 1 , wherein the first luminous flying vehicle comprises at least one luminous element positioned within a body of the first luminous flying vehicle.
35. The luminous pixel array of claim 34, wherein the at least one luminous element is positioned within a central portion of the body. 36. The luminous pixel array of claim 35, wherein the body of the first luminous flying vehicle is translucent or opaque.
37. The luminous pixel array of claim 1 , wherein the first luminous flying vehicle includes a vehicle control system comprising:
a micro-processing system;
positioning and localization systems electrically connected to the micro-processing system;
at least one luminous element electrically connected to the micro-processing system; a wireless transceiver connected to the micro-processing system; and
MIT-14079PCT 31 a power source constructed and arranged to provide a current to the micro-processing system, the positioning and localization systems, the at least one luminous element and the wireless transceiver. 38. The luminous pixel array of claim 37, wherein the micro-processing system is
configured to control a flight trajectory of the first luminous flying vehicle.
39. The luminous pixel array of claim 38, wherein the micro-processing system is further configured to control a color and light intensity of the at least one luminous element.
40. The luminous pixel array of claim 38, wherein the micro-processing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to control commands received from a ground-based control system. 41. The luminous pixel array of claim 38, wherein the micro-processing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to a predetermined flight trajectory stored in memory of the vehicle control system.
42. The luminous pixel array of claim 41 , wherein the positioning and localization systems comprise a navigation positioning system receiver configured to determine a position of the first luminous flying vehicle, and wherein the micro-processing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to the position of the first luminous flying vehicle. 43. A luminous pixel array system, comprising:
at least one luminous flying vehicle, the at least one luminous flying vehicle corresponding to at least one pixel of a luminous pixel array; and
a control system configured to wirelessly communicate with the at least one luminous flying vehicle.
44. The luminous pixel array system of claim 43, wherein the at least one luminous flying vehicle comprises a plurality of luminous flying vehicles.
MIT-14079PCT 32
45. The luminous pixel array system of claim 44, wherein two luminous flying vehicles of the plurality of luminous flying vehicles comprises one selected from the group consisting of: rotary-wing luminous flying vehicles, fixed-wing luminous flying vehicles and aerostat luminous flying vehicles.
46. The luminous pixel array system of claim 43, wherein the at least one luminous flying vehicle comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum. 47. The luminous pixel array system of claim 46, wherein the at least one luminous element comprises one selected form the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device. 48. The luminous pixel array system of claim 43 further comprising an optical motion capture system configured to transmit captured images of the at least one luminous flying vehicle to the control system.
49. The luminous pixel array system of claim 48, wherein the optical motion capture system comprises at least one infrared image capturing device.
50. The luminous pixel array system of claim 48, wherein the control system is further configured to reconstruct the spatial position of the at least one luminous flying vehicle based on the captured images.
51. The luminous pixel array system of claim 50, wherein the control system is further configured to determine a position and trajectory of the at least one luminous vehicle based on the captured images. 52. The luminous pixel array system of claim 50, wherein the control system is further configured to compute control commands based on a predetermined image-creating event stored in memory of the control system.
MIT-14079PCT 33
53. The luminous pixel array system of claim 52, wherein the control commands are transmitted by the control system to the at least one luminous flying vehicle, and wherein a vehicle control system of the luminous flying vehicle alters at least one of a flight trajectory and a luminous element color and intensity according to the control commands received from the control system.
54. The luminous pixel array system of claim 52, wherein the predetermined image- creating event comprises at least one of flight trajectory data and image/sequence data. 55. The luminous pixel array system of claim 54, wherein the flight trajectory data comprise a plurality of desired spatial positions for the at least one luminous flying vehicle as a function of time.
56. The luminous pixel array system of claim 54, wherein the flight trajectory data comprises a mathematical function describing a geometry of a flight trajectory of the at least one luminous flying vehicle as a function of time.
57. The luminous pixel array system of claim 54, wherein the image/sequence data comprises a plurality of luminous element color and intensity values for the at least one luminous flying vehicle as a function of time.
58. The luminous pixel array system of claim 52, wherein the control system is further configured to transmit the control commands to the at least one luminous flying vehicle. 59. The luminous pixel array system of claim 58, wherein the at least one luminous flying vehicle executes synchronized motions in space corresponding to control commands received from the control system.
60. The luminous pixel array system of claim 48, wherein the optical motion capture system is further configured to transmit the captured images of the at least one luminous flying vehicle to the control system via at least one of a wired communication line and a wireless communication link.
MIT-14079PCT 34
61. The luminous pixel array system of claim 43, wherein the control system comprises a memory device having a predetermined image-creating event stored therein.
62. The luminous pixel array system of claim 61 , wherein the control system is further configured to preprogram the at least one luminous flying vehicle with a predetermined flight trajectory and image/sequence.
63. The luminous pixel array system of claim 62, wherein the at least one luminous flying vehicle executes the image-creating event in response to the preprogramming of the predetermined flight trajectory and image/sequence.
64. The luminous pixel array system of claim 62, wherein the control system is further configured to transmit initialization and synchronization signals to the at least one luminous flying vehicle so as to coordinate the commencement and execution of the predetermined image-creating event by the at least one luminous flying vehicle.
65. The luminous pixel array system of claims 44, 46, 48 and 61, wherein the at least one luminous flying vehicle comprises a plurality of luminous flying vehicles. 66. A luminous pixel array, comprising:
a plurality of luminous flying vehicles arrange in 3 -dimensional space, wherein each luminous flying vehicle corresponds to at least one pixel of the luminous pixel array, and wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum.
67. The luminous pixel array of claim 66, wherein the plurality of luminous flying vehicles are arranged in space so as to form a 2-dimensional canvas in space. 68. The luminous pixel array of claim 67, wherein each of the plurality of luminous flying vehicles are configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to render first and second 2-dimensional images in space.
MIT-14079PCT 35
69. The luminous pixel array of claim 67, wherein the plurality of luminous flying vehicles are suspended in space.
70. The luminous pixel array of claim 67, wherein the plurality of luminous flying vehicles are airborne.
71. The luminous pixel array of claim 66, wherein the plurality of luminous flying vehicles are arranged in space so as to form a 3-dimensional shape in space. 72. The luminous pixel array of claim 71 , wherein each of the plurality of luminous flying vehicles are configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to create first and second 3-dimensional shapes in space.
73. The luminous pixel array of claim 71, wherein the plurality of luminous flying vehicles are suspended in space.
74. The luminous pixel array of claim 71 , wherein the plurality of luminous flying vehicles are airborne. 75. A luminous pixel array, comprising:
a plurality of luminous flying vehicles configured to move in 3-dimensional space, wherein a first luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one pixel of the luminous pixel array, and
wherein the first luminous flying vehicle is configured to radiate a first color and intensity of light.
76. The luminous pixel array of at least one of the preceding claims, wherein the at least one pixel of the luminous pixel array comprises a first pixel. 77. The luminous pixel array of at least one of the preceding claims, wherein the at least one pixel of the luminous pixel array further comprises a second pixel.
78. The luminous pixel array of at least one of the preceding claims, wherein each one of the plurality of luminous flying vehicles corresponds to a pixel of the luminous pixel array.
MIT-14079PCT 36
79. The luminous pixel array of at least one of the preceding claims, wherein each one of the plurality of luminous flying vehicles corresponds to one or more pixels of the luminous pixel array.
80. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle comprises at least one luminous element constructed and arranged to radiate the first color and intensity of light. 81. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element comprises an RGB light emitting diode.
82. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element comprises a red light emitting diode, a green light emitting diode and a blue light emitting diode.
83. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element comprises one selected from the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device.
84. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element comprises an electronic display device. 85. The luminous pixel array of at least one of the preceding claims, wherein a second luminous flying vehicle of the plurality of luminous flying vehicles corresponds to at least one other pixel of the luminous pixel array.
86. The luminous pixel array of at least one of the preceding claims, wherein the second luminous flying vehicle comprises at least one luminous element constructed and arranged to radiate a second color and intensity of light.
The luminous pixel array of at least one of the preceding claims, wherein the at least luminous element comprises at least one light emitting diode.
MIT-14079PCT 37
88. The Luminous pixel array of at least one of the preceding claims, wherein the at least one light emitting diode comprises at least one phosphor-type light emitting diode or at least one organic light emitting diode.
89. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are further configured to move in 3 -dimensional space so as to create 2-dimensional and 3-dimensional shapes that can move in space. 90. The luminous pixel array of at least one of the preceding claims, wherein a color and intensity of light is radiated by each of the plurality of luminous flying vehicles so as to render 2-dimensional and 3-dimensional images.
91. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through twenty- fifth luminous flying vehicles.
92. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through fiftieth luminous flying vehicles. 93. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through one-hundredth luminous flying vehicles.
94. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through one-thousandth luminous flying vehicles.
95. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through two-thousandth luminous flying vehicles.
96. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises second through five-thousandth luminous flying vehicles.
MIT-14079PCT 38
97. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises at least two rotary- wing luminous flying vehicles.
98. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises at least two fixed-wing luminous flying vehicles.
99. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles comprises at least two aerostat luminous flying vehicles.
100. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle is configured to radiate the first color and intensity of light for a first predetermined length of time, and is further configured to radiate a second color and intensity of light for a second predetermined length of time.
101. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle comprises an optical identification element that emits radiation in a non-visible spectrum.
102. The luminous pixel array of at least one of the preceding claims, wherein the optical identification element comprises an infrared light emitting diode.
103. The luminous pixel array of at least one of the preceding claims, wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises an optical identification element.
104. The luminous pixel array of at least one of the preceding claims, wherein the optical identification element is constructed and arranged to emit radiation in a non- visible spectrum.
105. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle comprises at least one luminous element positioned on an outer surface of the first luminous flying vehicle.
MIT-14079PCT 39
106. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element is positioned on the outer surface of a body of the luminous flying vehicle. 107. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element is positioned on the outer surface of a gas chamber of the luminous flying device.
108. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle comprises at least one luminous element positioned within a body of the first luminous flying vehicle.
109. The luminous pixel array of at least one of the preceding claims, wherein the at least one luminous element is positioned within a central portion of the body.
110. The luminous pixel array of at least one of the preceding claims, wherein the body of the first luminous flying vehicle is translucent or opaque.
111. The luminous pixel array of at least one of the preceding claims, wherein the first luminous flying vehicle includes a vehicle control system comprising:
a micro-processing system;
positioning and localization systems electrically connected to the micro-processing system;
at least one luminous element electrically connected to the micro-processing system; a wireless transceiver connected to the micro-processing system; and
a power source constructed and arranged to provide a current to the micro-processing system, the positioning and localization systems, the at least one luminous element and the wireless transceiver. 112. The luminous pixel array of at least one of the preceding claims, wherein the microprocessing system is configured to control a flight trajectory of the first luminous flying vehicle.
MIT-14079PCT 40
113. The luminous pixel array of at least one of the preceding claims, wherein the microprocessing system is further configured to control a color and light intensity of the at least one luminous element. 114. The luminous pixel array of at least one of the preceding claims, wherein the microprocessing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to control commands received from a ground-based control system.
115. The luminous pixel array of at least one of the preceding claims, wherein the micro- processing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to a predetermined flight trajectory stored in memory of the vehicle control system.
116. The luminous pixel array of at least one of the preceding claims, wherein the positioning and localization systems comprise a navigation positioning system receiver configured to determine a position of the first luminous flying vehicle, and wherein the micro-processing system is further configured to alter the flight trajectory of the first luminous flying vehicle in response to the position of the first luminous flying vehicle. 117. A luminous pixel array system, comprising:
at least one luminous flying vehicle, the at least one luminous flying vehicle corresponding to at least one pixel of a luminous pixel array; and
a control system configured to wirelessly communicate with the at least one luminous flying vehicle.
118. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous flying vehicle comprises a plurality of luminous flying vehicles.
119. The luminous pixel array system of at least one of the preceding claims, wherein two luminous flying vehicles of the plurality of luminous flying vehicles comprises one selected from the group consisting of: rotary-wing luminous flying vehicles, fixed-wing luminous flying vehicles and aerostat luminous flying vehicles.
MIT-14079PCT 41
120. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous flying vehicle comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum. 121. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous element comprises one selected form the group consisting of: an electron stimulated device, an incandescent lamp device, an electroluminescent lamp device, a gas discharge lamp device, and a high-intensity discharge lamp device. 122. The luminous pixel array system of at least one of the preceding claims further comprising an optical motion capture system configured to transmit captured images of the at least one luminous flying vehicle to the control system.
123. The luminous pixel array system of at least one of the preceding claims, wherein the optical motion capture system comprises at least one infrared image capturing device.
124. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to reconstruct the spatial position of the at least one luminous flying vehicle based on the captured images.
125. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to determine a position and trajectory of the at least one luminous vehicle based on the captured images. 126. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to compute control commands based on a predetermined image-creating event stored in memory of the control system.
127. The luminous pixel array system of at least one of the preceding claims, wherein the control commands are transmitted by the control system to the at least one luminous flying vehicle, and wherein a vehicle control system of the luminous flying vehicle alters at least one of a flight trajectory and a luminous element color and intensity according to the control commands received from the control system.
MIT-14079PCT 42
128. The luminous pixel array system of at least one of the preceding claims, wherein the predetermined image-creating event comprises at least one of flight trajectory data and image/sequence data. 129. The luminous pixel array system of at least one of the preceding claims, wherein the flight trajectory data comprise a plurality of desired spatial positions for the at least one luminous flying vehicle as a function of time.
130. The luminous pixel array system of at least one of the preceding claims, wherein the flight trajectory data comprises a mathematical function describing a geometry of a flight trajectory of the at least one luminous flying vehicle as a function of time.
131. The luminous pixel array system of at least one of the preceding claims, wherein the image/sequence data comprises a plurality of luminous element color and intensity values for the at least one luminous flying vehicle as a function of time.
132. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to transmit the control commands to the at least one luminous flying vehicle.
133. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous flying vehicle executes synchronized motions in space corresponding to control commands received from the control system. 134. The luminous pixel array system of at least one of the preceding claims, wherein the optical motion capture system is further configured to transmit the captured images of the at least one luminous flying vehicle to the control system via at least one of a wired
communication line and a wireless communication link. 135. The luminous pixel array system of at least one of the preceding claims, wherein the control system comprises a memory device having a predetermined image-creating event stored therein.
MIT-14079PCT 43
136. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to preprogram the at least one luminous flying vehicle with a predetermined flight trajectory and image/sequence. 137. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous flying vehicle executes the image-creating event in response to the preprogramming of the predetermined flight trajectory and image/sequence.
138. The luminous pixel array system of at least one of the preceding claims, wherein the control system is further configured to transmit initialization and synchronization signals to the at least one luminous flying vehicle so as to coordinate the commencement and execution of the predetermined image-creating event by the at least one luminous flying vehicle.
139. The luminous pixel array system of at least one of the preceding claims, wherein the at least one luminous flying vehicle comprises a plurality of luminous flying vehicles.
140. A luminous pixel array, comprising:
a plurality of luminous flying vehicles arrange in 3 -dimensional space, wherein each luminous flying vehicle corresponds to at least one pixel of the luminous pixel array, and wherein each luminous flying vehicle of the plurality of luminous flying vehicles comprises at least one luminous element constructed and arranged to emit radiation in the visible spectrum.
141. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are arranged in space so as to form a 2-dimensional canvas in space.
142. The luminous pixel array of at least one of the preceding claims, wherein each of the plurality of luminous flying vehicles are configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to render first and second 2- dimensional images in space.
143. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are suspended in space.
MIT-14079PCT 44
144. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are airborne. 145. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are arranged in space so as to form a 3 -dimensional shape in space.
146. The luminous pixel array of at least one of the preceding claims, wherein each of the plurality of luminous flying vehicles are configured to change one of a color and an intensity of light emitted by the at least one luminous element so as to create first and second 3- dimensional shapes in space.
147. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are suspended in space.
148. The luminous pixel array of at least one of the preceding claims, wherein the plurality of luminous flying vehicles are airborne.
MIT-14079PCT 45
PCT/US2011/042297 2011-06-29 2011-06-29 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays WO2013002778A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2011/042297 WO2013002778A1 (en) 2011-06-29 2011-06-29 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2011/042297 WO2013002778A1 (en) 2011-06-29 2011-06-29 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays

Publications (1)

Publication Number Publication Date
WO2013002778A1 true WO2013002778A1 (en) 2013-01-03

Family

ID=47424433

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/042297 WO2013002778A1 (en) 2011-06-29 2011-06-29 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays

Country Status (1)

Country Link
WO (1) WO2013002778A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016015943A1 (en) * 2014-08-01 2016-02-04 Koninklijke Philips N.V. System, device for creating an aerial image
WO2016033218A1 (en) * 2014-08-26 2016-03-03 Universal City Studios Llc Special effects techniques
US9776100B2 (en) 2014-11-06 2017-10-03 Disney Enterprises, Inc. Air delivered special effects
WO2017207920A1 (en) * 2016-06-03 2017-12-07 Drobot X System for controlling the movement of remote-controlled vehicles
WO2018195573A1 (en) * 2017-04-28 2018-11-01 Ars Electronica Linz Gmbh & Co Kg Unmanned aircraft with a modular swarm control unit

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080074346A1 (en) * 2006-09-27 2008-03-27 Erik Petrich Swept volume display
US20080125896A1 (en) * 2006-07-24 2008-05-29 The Boeing Company Closed-Loop Feedback Control Using Motion Capture Systems
US20080313937A1 (en) * 2007-06-20 2008-12-25 Boyce Mark A Aerial image projection system and method of utilizing same
US20100123415A1 (en) * 2008-11-20 2010-05-20 Blazen Illuminations, Llc Emulating light emission systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080125896A1 (en) * 2006-07-24 2008-05-29 The Boeing Company Closed-Loop Feedback Control Using Motion Capture Systems
US20080074346A1 (en) * 2006-09-27 2008-03-27 Erik Petrich Swept volume display
US20080313937A1 (en) * 2007-06-20 2008-12-25 Boyce Mark A Aerial image projection system and method of utilizing same
US20100123415A1 (en) * 2008-11-20 2010-05-20 Blazen Illuminations, Llc Emulating light emission systems

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016015943A1 (en) * 2014-08-01 2016-02-04 Koninklijke Philips N.V. System, device for creating an aerial image
US10068506B2 (en) 2014-08-01 2018-09-04 Philips Lighting Holding B.V. System, device for creating an aerial image
CN107206283A (en) * 2014-08-26 2017-09-26 环球城市电影有限责任公司 Special efficacy technology
RU2687763C2 (en) * 2014-08-26 2019-05-16 ЮНИВЕРСАЛ СИТИ СТЬЮДИОС ЭлЭлСи Technologies of special effects
JP2017526443A (en) * 2014-08-26 2017-09-14 ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー Special effects technology
US9504930B2 (en) 2014-08-26 2016-11-29 Universal City Studios Llc Special effects techniques
JP2019195658A (en) * 2014-08-26 2019-11-14 ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー Special effects techniques
KR20170046727A (en) * 2014-08-26 2017-05-02 유니버셜 시티 스튜디오스 엘엘씨 Special effects techniques
KR102410359B1 (en) 2014-08-26 2022-06-16 유니버셜 시티 스튜디오스 엘엘씨 Special effects techniques
US10058793B2 (en) 2014-08-26 2018-08-28 Universal City Studios Llc Special effects techniques
WO2016033218A1 (en) * 2014-08-26 2016-03-03 Universal City Studios Llc Special effects techniques
EP3698859A1 (en) * 2014-08-26 2020-08-26 Universal City Studios LLC Special effects techniques
CN110270112B (en) * 2014-08-26 2020-06-16 环球城市电影有限责任公司 Special effect technology
CN107206283B (en) * 2014-08-26 2019-09-20 环球城市电影有限责任公司 Special efficacy technology
CN110270112A (en) * 2014-08-26 2019-09-24 环球城市电影有限责任公司 Special efficacy technology
US9776100B2 (en) 2014-11-06 2017-10-03 Disney Enterprises, Inc. Air delivered special effects
WO2017207920A1 (en) * 2016-06-03 2017-12-07 Drobot X System for controlling the movement of remote-controlled vehicles
FR3052084A1 (en) * 2016-06-03 2017-12-08 Drobot X SYSTEM FOR CONTROLLING THE EVOLUTION OF REMOTE CONTROLS
WO2018195573A1 (en) * 2017-04-28 2018-11-01 Ars Electronica Linz Gmbh & Co Kg Unmanned aircraft with a modular swarm control unit
US11340608B2 (en) 2017-04-28 2022-05-24 Ars Electronica Linz Gmbh & Co Kg Unmanned aircraft with a modular swarm control unit

Similar Documents

Publication Publication Date Title
US9143769B2 (en) 3-D luminous pixel arrays, 3-D luminous pixel array control systems and methods of controlling 3-D luminous pixel arrays
CN106595639B (en) Positioning system and its localization method and device and robot
US10514710B2 (en) Unmanned aerial vehicle alignment system
US10068506B2 (en) System, device for creating an aerial image
US20190144114A1 (en) Systems and methods for controlling movable object behavior
US9415869B1 (en) Mobile antenna array
WO2013002778A1 (en) 3-d luminous pixel arrays, 3-d luminous pixel array control systems and methods of controlling 3-d luminous pixel arrays
US20200372808A1 (en) Secure unmanned aerial vehicle flight planning
US20170305537A1 (en) Un-manned aerial vehicle
US10678238B2 (en) Modified-reality device and method for operating a modified-reality device
US10303415B1 (en) Mobile display array
CN110209198A (en) A kind of unmanned plane cluster formation flight ground real-time control method and control device
US10725468B2 (en) Bounding-volume based unmanned aerial vehicle illumination management system
US20190315486A1 (en) Adaptive Voxels for Aerial Light Shows
US20160284256A1 (en) Airborne Advertising Platform
JP6525145B2 (en) Emitting point figure pattern display system using a flying object, a method of displaying a light emitting point figure pattern, and a flying object used for the system and method
US20200240602A1 (en) Systems and methods for optimizing searchlight operation parameters used to perform intelligent searchlight control
JP2019040309A (en) Flying body and formation flight control method by plurality of flying bodies
WO2015150017A1 (en) Flying drone trajectory synchronization
US11089235B2 (en) Systems and methods for automatic detection and correction of luminance variations in images
TW201822172A (en) Panoramic vision system
US20170053535A1 (en) Aircraft three-dimensional exhibition system and aircraft three-dimensional exhibition controlling method
CN108293286B (en) User-determinable configuration of a lighting device for selecting a light scene
JP6825166B2 (en) Aircraft and control method of air vehicle
US10002561B1 (en) Perceptually configured array of addressable electromagnetic emitter elements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11868429

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11868429

Country of ref document: EP

Kind code of ref document: A1