WO2017114504A1 - Facilitation de la vidéoconférence grand angle par un réseau d'uav - Google Patents

Facilitation de la vidéoconférence grand angle par un réseau d'uav Download PDF

Info

Publication number
WO2017114504A1
WO2017114504A1 PCT/CN2016/113725 CN2016113725W WO2017114504A1 WO 2017114504 A1 WO2017114504 A1 WO 2017114504A1 CN 2016113725 W CN2016113725 W CN 2016113725W WO 2017114504 A1 WO2017114504 A1 WO 2017114504A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
uav
wide
view
vehicle
Prior art date
Application number
PCT/CN2016/113725
Other languages
English (en)
Inventor
Wellen Sham
Original Assignee
Wellen Sham
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/341,813 external-priority patent/US9955115B2/en
Priority claimed from US15/341,831 external-priority patent/US9786165B2/en
Priority claimed from US15/341,824 external-priority patent/US9826256B2/en
Priority claimed from US15/341,797 external-priority patent/US10454576B2/en
Priority claimed from US15/341,809 external-priority patent/US9800321B2/en
Priority claimed from US15/341,818 external-priority patent/US20170193556A1/en
Application filed by Wellen Sham filed Critical Wellen Sham
Publication of WO2017114504A1 publication Critical patent/WO2017114504A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10—Simultaneous control of position or course in three dimensions
    • G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • G05D1/104—Simultaneous control of position or course in three dimensions specially adapted for aircraft involving a plurality of aircrafts, e.g. formation flying
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B7/00—Radio transmission systems, i.e. using radiation field
    • H04B7/14—Relay systems
    • H04B7/15—Active relay systems
    • H04B7/185—Space-based or airborne stations; Stations for satellite systems
    • H04B7/18502—Airborne stations
    • H04B7/18504—Aircraft used as relay or high altitude atmospheric platform
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B7/00—Radio transmission systems, i.e. using radiation field
    • H04B7/14—Relay systems
    • H04B7/15—Active relay systems
    • H04B7/185—Space-based or airborne stations; Stations for satellite systems
    • H04B7/18502—Airborne stations
    • H04B7/18506—Communications with or from aircraft, i.e. aeronautical mobile service
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/214—Specialised server platform, e.g. server located in an airplane, hotel, hospital
    • H04N21/2146—Specialised server platform, e.g. server located in an airplane, hotel, hospital located in mass transportation means, e.g. aircraft, train or bus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25841—Management of client data involving the geographical location of the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W16/00—Network planning, e.g. coverage or traffic planning tools; Network deployment, e.g. resource partitioning or cells structures
    • H04W16/24—Cell structures
    • H04W16/26—Cell enhancers or enhancement, e.g. for tunnels, building shadow
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/24—Connectivity information management, e.g. connectivity discovery or connectivity update
    • H04W40/248—Connectivity information update
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02—Power saving arrangements
    • H04W52/0203—Power saving arrangements in the radio access network or backbone network of wireless communication networks
    • H04W52/0206—Power saving arrangements in the radio access network or backbone network of wireless communication networks in access points, e.g. base stations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U10/00—Type of UAV
    • B64U10/10—Rotorcrafts
    • B64U10/13—Flying platforms
    • B64U10/14—Flying platforms with four distinct rotor axes, e.g. quadcopters
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00—UAVs specially adapted for particular uses or applications
    • B64U2101/20—UAVs specially adapted for particular uses or applications for use as communications relays, e.g. high-altitude platforms
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00—UAVs specially adapted for particular uses or applications
    • B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography

Definitions

  • the present disclosure relates tofacilitating video conferencing throughunmanned aerial vehicle, and more specifically to facilitating wide-view video conferencing through self-sustaining unmanned aerial vehicle.
  • UAV unmanned aerial vehicle
  • UAVs commonly known as a drone and also referred by several other names, is an aircraft without a human pilot aboard.
  • the flight of UAVs may be controlled either autonomously by onboard computers or by the remote control of a pilot on the ground or in another vehicle.
  • UAVs have mostly found military and special operation applications, but also are increasingly finding uses in civil applications, such as policing, surveillance and firefighting, and nonmilitary security work, such as inspection of power or pipelines.
  • UAVs are adept at gathering an immense amount of visual information and displaying it to human operators. However, it can take a great deal of time and manpower to interpret the information gathered by UAVs. In many cases, the information gathered by UAVs is misinterpreted by human operators and analysts who have a limited time window in which to interpret the information.
  • Video conferencing is generally known in the art. Multiple parties can communicate with each other through video and audio in a video conference.
  • Conventional video conference facilitating technologies typically require a fixed camera placed in a place where each party is located during the video conference. For video output, the view of other parties on a screen at one party’s location is often limited due to the camera placements and field of view at the other parties’location.
  • typically only one camera is used to capture a view at a party’s location during the video conference, and thus the field of view of that party can be limited to the size of that camera’s field of view. This presents a challenge particularly when the party has presenters during the video conference scattering around across a room.
  • the conventional video conference technologies typically cannot capture presenters scattering around at one location at once.
  • Embodiments are provided for facilitating a wide-view video conference through a UAV network.
  • UAVs for example drones can be employed to capture and transmit video data at locations of parties involved in the wide-view video conference.
  • one or more UAVs in the UAV network can be instructed to locate the party’s location and zoom-in onto the party’s location.
  • the UAV (s) may be instructed to move close to the party’s location and find an angel so that a clear view of the party’s location can be captured.
  • the UAV (s) can be equipped with one or more video cameras.
  • the UAV (s) can be equipped with a 360 degree video camera such that a wide-area covered by the 360 degree video can be captured.
  • the individual UAV (s) may simply carries a camera either fixed on the UAV at a certain angle with respect to the UAV or may be rotated around.
  • the video data can be transmitted to a video data processing center in real-time or substantially in real-time.
  • the video data transmission by the given UAV to the video data processing center can be through a UAV network.
  • the video data can be first transmitted to a controller that controls the given UAV, and from that controller, the video data can be relayed to the video processing center via a wired or wireless network.
  • the video data transmitted to the video processing center can include a wide field of view of the location of the party zoomed-in onto by the given UAV.
  • the video processing center can be configured to process the wide-view video data received from the given UAV for presentation onto a display.
  • the video conference center can be configured to provide capability to host the video conference and to route video data the parties in the video conference.
  • a display For outputting a video stream at a location of a given party in the video conference, a display may be equipped with a network connection.
  • the display can receive video data from the video processing center through the network connection.
  • the display may be operatively connected to a computing device and the computing device may be configured to receive the video data from video processing center through the network connection.
  • At least one party of the video conference is located in a transportation apparatus, such as a car.
  • the transportation apparatus may have at least one cabin.
  • the transportation apparatus is equipped with a wide-view display such as a dashboard covered by a LCD screen.
  • one or more UAVs can be instructed to zoom-in onto the transportation apparatus to capture a wide view of the cabin.
  • the other party or other parties in the video conference may include another transportation apparatus. In this way, a wide-view video conference between moving transportation apparatus can be established
  • FIG. 1 illustrates an exemplary UAV network in accordance with the disclosure.
  • FIG. 2 conceptually illustrates facilitating a wide-view video conference using UAVs in accordance with the disclosure.
  • FIG. 3 illustrates an example of a controller shown in FIG. 1.
  • FIG. 4 illustrates an exemplary method for instructing a UAV to capture an interior of a vehicle is illustrated.
  • FIG. 4 illustrates another example of a communication protocol that can be used to communicate information to a given vehicle via a UAV and a processing station shown in FIG. 1.
  • FIG. 5 illustrates an example of a video processing center shown in FIG. 2.
  • FIG. 6 illustrates an exemplary method for hosting a wide-view video conference.
  • FIG. 7 illustrates a simplified computer system, according to an exemplary embodiment of the present disclosure.
  • UAVs are well suited for applications where the payload consists of optical image sensors such as cameras with powerful lightweight sensors suited for a variety of commercial applications such as surveillance, video conferencing, vehicle positioning, and/or any other applications.
  • a UAV in accordance with the disclosure can collect multi-spectral imagery of any object in an area covered the UAV.
  • the UAV in accordance with the disclosure can fly up to 65,000 feet and can cover as much as 500 km in range.
  • One motivation of the present disclosure is to employ UAVs to facilitate video-conferencing involving at least one transportation apparatus, such as an automobile, a bus, or a train.
  • One or more UAVs can be employed to capture video images of an interior of the transportation apparatus, such as a cabin of the transportation apparatus. Since UAV can be configured to move at a speed consistent with a speed of the transportation apparatus above the transportation apparatus, video images of the transportation apparatus can be restively simply captured by the UAV when the transportation apparatus moves.
  • the UAV equipped with a wide-view e.g., 360 degree, camera
  • the wide-view video data can be transmitted from the UAV to a video processing center via a ground controller of the UAV network.
  • the wide-view video images of the interior of the transportation apparatus can be transmitted to other parties for presentation.
  • a wide-view video conference can be facilitated.
  • multiple parties of the video conference include two or more transportation apparatus. In those implementations, wide-view video conference between multiple transportation apparatus can be facilitated.
  • FIG. 1 illustrates an exemplary UAV network 100 for facilitating communications for a vehicle in accordance with the disclosure.
  • the UAV network 100 can comprise multiple UAVs 102, such as UAVs 102a-f.
  • the UAV network 100 in certain embodiments, can comprise hundreds, thousands, or even tens of thousands of UAVs 102.
  • the individual UAVs 102 in UAV network 100 can fly above the ground, between 50,000 to 65,000 feet altitude. However, this is not intended to be limiting. In some examples, some or all of the UAVs 102 in the UAV network 100 can fly at hundreds or thousands feet above the ground.
  • the individual UAVs 102 in the UAV network 100 can communicate with each other through communication hardware carried by or installed on UAVs 102.
  • the communication hardware onboard a UAV 102 can include an antenna, a high frequency radio transceiver, an optical transceiver, and/or any other communication components for long range communications.
  • a communication channel between any two given UAVs 102 in UAV network 100, for example, UAV 102c and UAV 102d, can be established.
  • UAVs 102a, 102b and 102c are neighboring UAVs such that they cover neighboring areas 104a, 104b, and 104c respectively. They can be configured to communicate with each other once they are within a threshold distance.
  • the threshold distance can be the maximum communications range of the transceivers onboard the UAVs 102a, 102b, and 102c. In this way, UAVs 102a, 102b, and 102c can send data to each other without an access point.
  • a controller may be referred to as a piece of hardware and/or software configured to control communications within UAV network 100.
  • the controller can be provided by a ground processing station, such as ground controller 110a, 110b, or 110c.
  • the controller can be implemented by a computer server housed in a controller 110.
  • the controller can be provided by a UAV 102 in the UAV network 100.
  • a given UAV 102 such as an unmanned helicopter or a balloon, in the UAV network 100 can carry payloads including one or more of a processor configured to implement the controller.
  • the controller can be configured to determine network requirements based on an application supported by UAV network 100, and/or to perform any other operations.
  • control signals can be transmitted via a control link from the controller to the UAVs 102 shown in FIG. 1.
  • an important criteria to a UAV 102 in the network is altitude.
  • the signals emitted by UAV 102 becomes weaker.
  • a UAV 102 flying at an altitude of 65,000 feet can cover an area up to 100 kilometers on the ground, but the signal loss can be significantly higher than would occur for a terrestrial network.
  • Radio signals typically requires a large amount of power for transmission in long distance.
  • the payloads can be carried by a UAV 102 that stays in the air for an extended period of time is limited.
  • solar energy can be used to power the UAV 102. However this limits the weight of payloads that can be carried by a UAV 102 due to the limited rate at which solar irritation can be absorbed and converted to electricity.
  • Free-space optical communication is an optical communication technology that transmits light in free space to wirelessly transmit data for telecommunications.
  • Commercially available FSO systems use wave length close to visible spectrum around 850 to 1550 nm.
  • two FSO transceivers can be placed on both sides of transmission path that has unobstructed line-of-sight between the two FSO transceivers.
  • a variety of light sources can be used for the transmission of data using FSO transceivers. For example, LED and laser can be used to transmit data in a FSO system.
  • a FSO unit can be included in the payloads of a UAV 102 for communication.
  • the FSO unit can include an optical transceiver with a laser transmitter and a receiver to provide full duplex bi-directional capability.
  • the FSO unit can use a high-power optical source, i.e., laser, and a lens to transmit the laser beam through the atmosphere to another lens receiving the information embodied in the laser beam.
  • the receiving lens can connect to a high-sensitivity receiver via optical fiber.
  • the FSO unit included in a UAV 102 in accordance with the disclsoure can enable optical transmission at speeds up to 10Gbps.
  • a given vehicle 106 can be equipped with communication hardware.
  • the communication hardware in the given vehicle 106 can include a FSO unit described above, a radio transceiver, and/or any other type of communication hardware.
  • the communication hardware included in the vehicle 106 can be used to establish a communication channel between the vehicles 106 via the UAVs 102.
  • a controller 110 can include a FSO unit configured to establish a communication channel FSO unit through laser beam. Through the communication channel, UAV 102 can be configured to communicate its geo-locations to controller 110. Since ground controller 110 is stationary, the geo-location of ground controller 110 can be preconfigured into an onboard computer in UAVs 102.
  • the ground controller 110 can be connected to a wired or wireless network.
  • Information intended for vehicle 106 can be communicated through the wired or wireless network from or to another entity connected to the wired or wireless network.
  • the information intended for vehicle 106 can be first communicated to the UAV 102 through laser beam, and the UAV 102 can forward the information to vehicle 106 through laser beam 204a.
  • a tracking signal can be transmitted from UAV 102 for tracking vehicle 106.
  • the tracking signal can be in various forms.
  • the UAV 102 may scan the covered area 104 with a camera aboard UAV 102 in a pre-determined pattern.
  • the UAV 102 may scan the covered area 104 in a scan line fashion from on one corner of the covered area 104 to the opposite corner of the covered area 104.
  • the UAV 102 may scan the covered area 104 in a concentric sphere fashion starting from an outer sphere within the covered area 104, gradually into inner spheres within the covered area 104 until the center of the covered area 104.
  • the UAV 102 may scan the covered area along predefined lines of areas 104, for example a portion of a road that enters area 104 and another portion of the road that exits area 104.
  • the UAV 102 may carry a radio transmitter configured to broadcast in radio signals within the covered area 104.
  • the broadcast radio signals can serve as tracking signals such that once they are intercepted by a vehicle 106 passing through the covered area 104, the UAV 102 can be configured to location a position of the vehicle 106 within the covered area 104.
  • An identification of the vehicle 106 can be captured after the vehicle 106 has been tracked by UAV 102.
  • the identification of the vehicle 106 can be captured by a camera carried by the UAV 102.
  • the UAV 102 may be configured to capture a picture of a license plate of vehicle 106 once it has been tracked.
  • the UAV 102 may be configured to transmit a request to vehicle 106 to inquire about its identification, and the vehicle 106 can send its identification to the UAV 102 in response to the request.
  • any one of the UAVs 102 shown in FIG. 1 may be instructed to “monitor” or “zoom-in onto” a corresponding vehicle 106.
  • the UAV 102a may receive location information regarding vehicle 106a and instructions to zoom-in onto vehicle 106a.
  • the UAV 102a may be configured to track vehicle 106a based on the received location information. The may involve moving the UAV 102a into a vicinity of vehicle 106a such that UAV 102a has a clear view of vehicle 106.
  • the instructions received by UAV 102a may include capturing video images of interior of vehicle 106a.
  • UAV 102a may be equipped with one or more cameras.
  • the camera (s) carried by UAV 102a may include a wide-view camera capable of capturing a wide field of view.
  • the wide-view camera carried by UAV 102a is an omnidirectional camera with a 360-degree field of view in a horizontal plane, or with a visual field that covers (approximately) the entire sphere.
  • the cameras carried by UAV 102a may include multiple cameras fixed at corresponding locations on an underbody ofUAV 102a. In one embodiment, the multiple cameras may be arranged on the underbody of UAV 102a to form a ring. In one configuration, 8 cameras are used to form such a ring. One or more of those cameras can be employed to capture the interior of vehicle 106a depending on a distance between UAV 102a and vehicle 106a, an angle between the two, and/or any other factors. For example, three cameras in the ring may be employed by UAV 102a to capture video images of the interior of vehicle 106a. In some implementations, individual cameras carried by UAV 102a may have panoramic view capability. For example, various types of panoramic view cameras may be carried by UAV 102a, including short rotation, full rotation, fixed lens, and any other types of panoramic view cameras.
  • FIG. 2 conceptually illustrates facilitating a wide-view video conference using UAVs in accordance with the disclosure.
  • individual UAVs 102 in the UAV network 100 can be instructed to capture video images of interior of a vehicle 102 as described above.
  • UAV 102a on a request, can be positioned such that it captures video images of the interior of vehicle 106a.
  • the video images captured by UAV 102a may include wide-view video of the interior of vehicle 106a.
  • UAV 102a may be configured to capture 360 video of the interior of vehicle 106a using one or more 360 degree camera as described above.
  • UAV 102a in response to an instruction to capture video images of vehicle 106a received, for example from controller 110a, UAV 102a can be configured to be positioned such that UAV 102a has a clear line of sight with respect to vehicle 106a.
  • the position ofUAV 102a with respect to vehicle 106a can be adjusted based on the video images of vehicle 106a as captured by UAV 102a. For instance, when the video images are determined not to show a wide-view of the interior of vehicle 106a, the UAV 102a can be instructed to reposition itself until acceptable quality of wide-view video images of the interior of vehicle 106a are received. This may involve instructing the UAV 102a to adjust its angle, distance, speed, and/or any other aspects with respect to vehicle 106a.
  • UAV 102a can be configured to transmit video data to a corresponding controller 110a via UAV network in a communication way described above.
  • the video data may be first transmitted to another UAV 102 in proximity to UAV 102a.
  • UAV 102 may have more computing power or capability than UAV 102a, which may be a lightweight UAV configured to follow moving vehicles and to capture video images of interiors of the moving vehicles.
  • the UAV with more computing power can be used as a relay station to relay video data from UAV 102a to controller 110a for further processing of the video data.
  • the controller 110a may be configured to 1) communicate control instructions with the video processing center 202 and with the UAV 102a; 2) receive video data from UAV 102a; 3) transmit the video data from the UAV 102a to the video processing center 202; and/or to perform any other operations.
  • the communications between the controller 110a and video processing center 202 may follow a video conferencing protocol, such as the H. 323 protocol. H. 323 is well understood in the art, and details of this protocol will not be repeated herein.
  • the controller 110a may server as an interface between UAV 102a and video processing center 202 for facilitating the wide-view video conferencing in accordance with the disclosure.
  • the communications between the controller 110a and video processing center 202 may include receiving video conferencing instructions from the video processing center 202, transmitting video data captured by UAV 102a to video processing center 202, transmitting video conferencing data to the video processing center 202.
  • controller 110a may be configured to receive instructions from video processing center 202 indicating a video conferencing call is to be initiated with a specific vehicle, such as vehicle 106a.
  • the controller 110a can be configured to generate an instruction to instruct a corresponding UAV, such as UAV 102a to locate vehicle 106a and to capture video images of vehicle 102a to facilitate the video conference requested by video processing center 202.
  • the controller 110a can transmit the video data received from UAV 102a to the video processing center 202.
  • the controller 110a can also be configured to transmit conference data such as data loss indications, data packets received so far, synchronization messages, and/or any other video conferencing data to the video processing center 202 to facilitate the wide-view video conferencing.
  • the video processing center 202 can be configured to 1) host a wide-view video conference in accordance with the disclosure; 2) communicate video conference instructions to controller 110a; 3) receive video data from controller 110a; 4) process video data from controller 110a to facilitate a wide-view video conference; 5) communicate control instructions with controller 110a; 6) transmit process video data to other party or parties in the video conference hosted by the video conference center 202; and/or to perform any other operations.
  • Hosting a wide-view video conference by the video processing center 202 may include receiving a request from a party to establish a wide-view video conference with one or more other parties.
  • the video processing center 202 can be configured to receive a request from a vehicle 106a to establish a wide-view video conference with another vehicle 106.
  • Such a request may be received by video processing center 202 via network 204, which may include a wired and/or a wireless network.
  • network 204 can include the Internet.
  • vehicle 106a may be configured to make a video conference call to video processing center 202 via network 204.
  • the video processing center 202 may be configured to initiate a wide-view video conference by generating control instructions on its own.
  • the control instructions generated by video processing center 202 can include instructing a controller 110a corresponding to the other vehicle 106 as requested by 102a to capture video images of the other vehicle 106.
  • video processing center 202 can be configured to receive a request from a computing device to initiate a wide-view video conference call with the vehicle 106a. For instance, such a request may be received from a video conference device in an office building, where the wide-view video conference request is made by a party of one or more people located in an office in the office building. In that example, the video processing center 202 may generate control instructions to controller 110a to have it generate control instructions to capture wide-view video images of the interior of the vehicle 106a.
  • video processing center 202 can be configured to communicate control instructions with controller 110a via network 204.
  • the control instructions may include instructions transmitted by video processing center 202 to request the controller 110a to generate instructions to capture wide-view video images of the interior of vehicle 106a.
  • the control instructions may include instructions transmitted by controller 110 to indicating various status of video image capturing for vehicle 106a, such as data packets received so far, data packets lost so far, and/or any other control instructions to facilitate video processing center 202 to process and/or synchronize video data from controller 110a.
  • the control instructions may include instructions transmitted by video processing center 202 requesting the controller 110 to terminate wide-view video image capturing of vehicle 106a.
  • control instructions may include instructions transmitted by video processing center 202 indicating various statistics regarding video processing center 202.
  • the video processing center 202 may be configured to transmit control instructions to controller 110 indicating its throughput rate, its current CPU load, its current threads available and/or any other statistics to assist the controller 110 to determine a quality of wide-view video images that should be captured by UAV 102a.
  • video processing center 202 can be configured to process video data received from controller 110.
  • the video processing by video processing center 202 may include synthesizing the video data to generate a wide-view of the interior of vehicle 102a.
  • the UAV 102a may be equipped with multiple cameras configured to capture a subject from different angles.
  • the video data received from controller 110 can include video images captured by those cameras in separate channels. For instance, a first camera of UAV 102a can be configured to capture the interior of vehicle 106a from a first angle; a second camera of UAV 102a can be configured to capture the interior of vehicle 106a from a second angle, and so on.
  • the video data received from controller 110 may be in a form such that the video images of the interior of the vehicle 106a as captured by the first camera is in a first channel, video images of the interior of the vehicle 106a as captured by the second camera is in a second channel, and so on.
  • the video processing center 202 may be configured to assemble the video images transmitted in the different channels to form wide-view video images of the vehicle 106a.
  • the video processing by the video processing center 202 can include synchronizing the video data received from controller 110. Since the UAV network 110 and/or network 204 may be “best effort” network, video data transmitted through those networks may be out of sequence when they are received video processing center 202. In those embodiments, the video processing center 202 may be configured to process the video data received from controller 110 to ensure the packets received from controller are in sequence. In some examples, certain video packets may be lost along the way when transmitted to video processing center 202. In those examples, the video processing center 202 may be configured to instruct controller 110 to retransmit the lost video packets.
  • video processing center 202 may be configured to assemble video feeds for different parties in the wide-view video conference to form a combined view of those parties. For example, when the wide-view video conference includes more than two parties, the video processing center 202 may be configured to combine feeds from two of those parties for transmission to a given party in the wide-view video conference.
  • video processing center 202 may be configured to combine video data received from controller 110 with audio data.
  • the video processing center 202 can be configured to receive audio data for vehicle 106a from network 204.
  • the audio portion of the wide-view conference can be captured using a recording device such as microphone placed within vehicle 106a, and the captured audio data can be transmitted to video processing center 202 via the network 204.
  • the video processing center 202 after receiving the audio data from vehicle 106a, the video processing center 202 can be configured to synchronize the video and audio data for transmission to one or more other parties in the wide-view conference.
  • the video processing center 202 may be configured to output video images of wide-view video images of one or more parties to a given party in the wide-video conference hosted by the processing center 202.
  • one party in the wide-view video conference may be vehicle 106a
  • a second party in the wide-view video conference may be another vehicle, such as vehicle 106b
  • a third party in the wide-view video conference may be one or more people in an office located in a building using a video conferencing device, and/or any other party or parties.
  • the video processing center 202 may be configured to combine feeds from the second party and the third party to form wide-view video images of those parties and transmit the combined video images to vehicle 106a via network 204.
  • Vehicle 102a may be equipped with one or more wide-view displays for outputting the wide-view video images received from the video processing center 202.
  • the vehicle 106a may be equipped with a dashboard covered by a LCD screen.
  • the video images for the second and third parties as received from the video processing center 202 can be output the dashboard LCD screen to facilitate person or people within vehicle 106a to have the wide-view conference with the second and third parties.
  • video processing center 202 may be configured to combine the wide-view video data from UAV 102a and the video feed from second party for output to the video conferencing device in the office.
  • the video conferencing device may include a panoramic display with a wide screen.
  • the controller 110 may include one or more of a processor 302 configured to execute program components.
  • the program components may include a communication component 304, a UAV control component 306, a control instruction component 308, a video data component 310, and/or any other components.
  • the communication component 304 can be configured to communicate with a video processing center, such as video processing center 202 shown in FIG. 2.
  • the communications between the controller 110 and video processing center 202 may follow a video conferencing protocol, such as the H. 323 protocol.
  • the communication component 304 may be configured with H. 323 protocol stack to perform communication with video processing center 202 accordingly.
  • the communication between the controller 110 and video processing center 202 may include a request from the video processing center 202.
  • the request may indicate that a wide-view video conference involving a vehicle, such as vehicle 106a is being facilitated by video processing center 202 and the controller 110 is requested to capture wide-view video images of the interior of the vehicle 106a.
  • the UAV control component 306 can be configured to locate a vehicle as requested in the request for a wide-view video conference. For example, after receiving the request from video processing center 202 for a wide-view video conference involving vehicle 106a, the UAV control component 306 can be configured to identify whereabouts about the vehicle 106a. In some implementations, the UAV control component 306 may be configured to obtain locations regarding the vehicle 106 after the vehicle 106a is requested, for example in the wide-view video conference request from the video processing center 202. For instance, GPS information regarding the locations of vehicle 106a may be periodically transmitted to controller 110 or may be stored in a location database operatively connected controller 110. As another example, locations of vehicle 106 may be identified through UAV network.
  • UAV control component 306 may be configured to send a broadcast message to one or more UAVs within proximity of controller 110 for locating UAV 106a.
  • the UAV control component 306 may be configured to receive location information regarding vehicle 106a from a given UAV, such as UAV 102a after the broadcast message having been sent.
  • the control instruction component 308 can be configured to generate a control instruction.
  • the control instruction generated by control instruction component 308 can include an instruction instructing a UAV, such as UAV 102a, to capture wide-view video images of the interior of a vehicle, such as vehicle 106a.
  • the control instruction generated by control instruction component 308 can include an instruction indicating a status of the video capturing of the interior of vehicle 106a to the video processing center 202. Such a control instruction can be transmitted to the video processing center 202 to assist the processing by the video processing center 202.
  • the video data component 310 can be configured to receive video data from a UAV and transmit the received data to a video processing center 202 for further processing of the received video data.
  • the video data component 310 can be configured to receive the video data from the UAV, such as UAV 102a via the UAV network 100. After receiving the video data from UAV 102a, the video data component 310 can be configured to transmit the received video data simultaneously or substantially simultaneously to the video processing center 202 for further processing.
  • FIG. 4 where an exemplary method for instructing a UAV to capture an interior of a vehicle is illustrated.
  • the particular series of processing steps depicted in FIG. 4 is not intended to be limiting. It is appreciated that the processing steps may be performed in an order different from that depicted in FIG. 4 and that not all the steps depicted in FIG. 4 need be performed.
  • the method 400 may be implemented by a controller in a UAV network, such as the controller shown in FIG. 3.
  • the method depicted in method 400 may be implemented in one or more processing devices (e.g., a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information) .
  • the one or more processing devices may include one or more devices executing some or all of the operations of method 400 in response to instructions stored electronically on an electronic storage medium.
  • the one or more processing devices may include one or more devices configured through hardware, firmware, and/or software to be specifically designed for execution of one or more of the operations of method 400.
  • a request to capture wide-view video of a transportation apparatus is received.
  • operations involved in 402 can be implemented by a communication component the same as or substantially similar to the communication component 304 illustrated and described herein.
  • the transportation apparatus can be located through an UAV.
  • Operations involved in 404 may include generating an instruction to instruct the UAV to locate the transportation apparatus, such as the vehicle 106a.
  • operations involved in 404 can be implemented by a communication component the same as or substantially similar to the communication component 304 illustrated and described herein.
  • an instruction instructing the UAV to capture wide-view video images of the interior of the transportation apparatus is generated.
  • operations involved in 406 can be implemented by a control instruction component the same as or substantially similar to the control instruction component 308 illustrated and described herein.
  • video data can be received from the UAV.
  • operations involved in 408 can be implemented by a video data component the same as or substantially similar to the video data component 310 illustrated and described herein.
  • the video data received at 408 can be transmitted to a video processing center for further processing.
  • operations involved in 410 can be implemented by a video data component the same as or substantially similar to the video data component 310 illustrated and described herein.
  • the video processing center 202 may include one or more of a processor 502 configured to execute program components.
  • the program components may include a video conference request component 504, an addressing component 506, a UAV communication component 508, a video component 510 and/or any other components.
  • the video conference component 504 can be configured to receive a request for initiating a wide-view video conference. This may include receiving the request from a party to establish a wide-view video conference with one or more other parties.
  • the video conference component 504 can be configured to receive the request from a vehicle 106a to establish a wide-view video conference with another vehicle 106.
  • Such a request may be received by video conference component 504 via network 204, which may include a wired and/or a wireless network.
  • network 204 can include the Internet.
  • vehicle 106a may be configured to make a video conference call to video conference component 504 via network 204.
  • the addressing component 506 can be configured to identify an address of a party involved in the video conference as indicated in the request received by video conference component 504. This may include identifying a reachable address of the party. For example, when the party is a vehicle, the addressing component 506 can be configured to identify which controller 110 may be responsible for controlling communications with and/or video capturing of the vehicle. As another example, when the party is a landline conference device, the address component 506 can be configured to determine an internet address of the landline conference device. In implementations, the addressing component 506 can be configured to communicate with a directory server for determine or identify a reachable address of the party.
  • the UAV communication component 508 can be configured to communicate with a UAV controller via a network, such as the network 204. Communication by UAV communication component 508 with the UAV controller can include communicating control instructions generated by the video processing center 202 to UAV controller. For example, in response to receiving a request to initiate a wide-view video conference as described, the video processing center 202 may be configured to initiate a wide-view video conference by generating control instructions on its own. For example, the control instructions generated by video processing center 202 can include instructing a controller 110a corresponding to the other vehicle 106 to capture video images of the other vehicle 106. Such control instructions can be communicated to the controller 110 by the communication component 508 via the network 204.
  • control instructions may include instructions requesting the controller 110a to terminate wide-view video image capturing of vehicle 106a.
  • the control instructions may include instructions transmitted by video processing center 202 indicating various statistics regarding video processing center 202.
  • the video processing center 202 may be configured to transmit control instructions to controller 110 indicating its throughput rate, its current CPU load, its current threads available and/or any other statistics to assist the controller 110 to determine a quality of wide-view video images that should be captured by UAV 102a.
  • the video data component 510 can be configured to process video data received from a UAV controller.
  • the video processing by video data component 510 may include synthesizing the video data to generate a wide-view of the interior of a transportation apparatus.
  • a UAV may be equipped with multiple cameras configured to capture a subject from different angles.
  • the video data received from controller 110a can include video images captured by those cameras in separate channels.
  • a first camera ofUAV 102a can be configured to capture the interior of vehicle 106a from a first angle
  • a second camera ofUAV 102a can be configured to capture the interior of vehicle 106a from a second angle, and so on.
  • the video data received from controller 110a may be in a form such that the video images of the interior of the vehicle 106a as captured by the first camera is in a first channel, video images of the interior of the vehicle 106a as captured by the second camera is in a second channel, and so on.
  • the video data component 506 may be configured to assemble the video images transmitted in the different channels to form wide-view video images of the vehicle 106a.
  • the video processing by the video data component 510 can include synchronizing the video data received from controller 110. Since the UAV network 110 and/or network 204 may be “best effort” network, video data transmitted through those networks may be out of sequence when they are received video data component 510. In those embodiments, the video data component 510 may be configured to process the video data received from controller 110a to ensure the packets received from controller are in sequence. In some examples, certain video packets may be lost along the way when transmitted to video data component 510. In those examples, the video data component 510 may be configured to instruct controller 110a to retransmit the lost video packets.
  • video data component 510 may be configured to assemble video feeds for different parties in the wide-view video conference to form a combined view of those parties. For example, when the wide-view video conference includes more than two parties, the video data component 510 may be configured to combine feeds from two of those parties for transmission to a given party in the wide-view video conference.
  • video data component 510 may be configured to combine video data received from controller 110 with audio data.
  • the video data component 510 can be configured to receive audio data for vehicle 106a from network 204.
  • the audio portion of the wide-view conference can be captured using a recording device such as microphone placed within vehicle 106a, and the captured audio data can be transmitted to video data component 510 via the network 204.
  • the video data component 510 after receiving the audio data from vehicle 106a, the video data component 510 can be configured to synchronize the video and audio data for transmission to one or more other parties in the wide-view conference.
  • FIG. 6 where an exemplary method for hosting a wide-view video conference.
  • the particular series of processing steps depicted in FIG. 6 is not intended to be limiting. It is appreciated that the processing steps may be performed in an order different from that depicted in FIG. 6 and that not all the steps depicted in FIG. 6 need be performed.
  • the method 600 may be implemented by a video processing center, such as the video processing center shown in FIG. 5.
  • the method depicted in method 600 may be implemented in one or more processing devices (e.g., a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information) .
  • the one or more processing devices may include one or more devices executing some or all of the operations of method 600 in response to instructions stored electronically on an electronic storage medium.
  • the one or more processing devices may include one or more devices configured through hardware, firmware, and/or software to be specifically designed for execution of one or more of the operations of method 600.
  • a request to initiate a wide-view video conference involving a transportation apparatus is received.
  • operations involved in 602 can be implemented by a video conference request component the same as or substantially similar to the video conference request component 506 illustrated and described herein.
  • a UAV controller is communicated for capturing wide-view video data of a transportation apparatus.
  • operations involved in 604 can be implemented by a UAV communication component the same as or substantially similar to the UAV communication component 508 illustrated and described herein.
  • wide-view video data from the UAV controller can be received.
  • operations involved in 606 can be implemented by a UAV communication component the same as or substantially similar to the UAV communication component 508 illustrated and described herein.
  • video data received at 606 can be processed.
  • operations involved in 608 can be implemented by a video data component the same as or substantially similar to the video data component 510 illustrated and described herein.
  • the video data processed at 608 can be transmitted to a party of the wide-view video conference for presentation.
  • operations involved in 610 can be implemented by a video data component the same as or substantially similar to the video data component 510 illustrated and described herein.
  • FIG. 7 illustrates a simplified computer system that can be used implement various embodiments described and illustrated herein.
  • a computer system 700 as illustrated in FIG. 7 may be incorporated into devices such as a portable electronic device, mobile phone, or other device as described herein.
  • FIG. 7 provides a schematic illustration of one embodiment of a computer system 700 that can perform some or all of the steps of the methods provided by various embodiments. It should be noted that FIG. 7 is meant only to provide a generalized illustration of various components, any or all of which may be utilized as appropriate. FIG. 7, therefore, broadly illustrates how individual system elements may be implemented in a relatively separated or relatively more integrated manner.
  • the computer system 700 is shown comprising hardware elements that can be electrically coupled via a bus 705, or may otherwise be in communication, as appropriate.
  • the hardware elements may include one or more processors 710, including without limitation one or more general-purpose processors and/or one or more special-purpose processors such as digital signal processing chips, graphics acceleration processors, and/or the like; one or more input devices 715, which can include without limitation a mouse, a keyboard, a camera, and/or the like; and one or more output devices 720, which can include without limitation a display device, a printer, and/or the like.
  • the computer system 700 may further include and/or be in communication with one or more non-transitory storage devices 725, which can comprise, without limitation, local and/or network accessible storage, and/or can include, without limitation, a disk drive, a drive array, an optical storage device, a solid-state storage device, such as a random access memory ( “RAM” ) , and/or a read-only memory ( “ROM” ) , which can be programmable, flash-updateable, and/or the like.
  • RAM random access memory
  • ROM read-only memory
  • Such storage devices may be configured to implement any appropriate data stores, including without limitation, various file systems, database structures, and/or the like.
  • the computer system 700 might also include a communications subsystem 730, which can include without limitation a modem, a network card (wireless or wired) , an infrared communication device, a wireless communication device, and/or a chipset such as a Bluetooth TM device, an 702.11 device, a WiFi device, a WiMax device, cellular communication facilities, etc., and/or the like.
  • the communications subsystem 730 may include one or more input and/or output communication interfaces to permit data to be exchanged with a network such as the network described below to name one example, other computer systems, television, and/or any other devices described herein.
  • a portable electronic device or similar device may communicate image and/or other information via the communications subsystem 730.
  • a portable electronic device e.g. the first electronic device
  • the computer system 700 will further comprise a working memory 735, which can include a RAM or ROM device, as described above.
  • the computer system 700 also can include software elements, shown as being currently located within the working memory 735, including an operating system 740, device drivers, executable libraries, and/or other code, such as one or more application programs 745, which may comprise computer programs provided by various embodiments, and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein.
  • an operating system 740 operating system 740
  • device drivers executable libraries
  • application programs 745 which may comprise computer programs provided by various embodiments, and/or may be designed to implement methods, and/or configure systems, provided by other embodiments, as described herein.
  • code and/or instructions can be used to configure and/or adapt a general purpose computer or other device to perform one or more operations in accordance with the described methods.
  • a set of these instructions and/or code may be stored on a non-transitory computer-readable storage medium, such as the storage device (s) 725 described above.
  • the storage medium might be incorporated within a computer system, such as computer system 700.
  • the storage medium might be separate from a computer system e.g., a removable medium, such as a compact disc, and/or provided in an installation package, such that the storage medium can be used to program, configure, and/or adapt a general purpose computer with the instructions/code stored thereon.
  • These instructions might take the form of executable code, which is executable by the computer system 700 and/or might take the form of source and/or installable code, which, upon compilation and/or installation on the computer system 700 e.g., using any of a variety of generally available compilers, installation programs, compression/decompression utilities, etc., then takes the form of executable code.
  • some embodiments may employ a computer system such as the computer system 700 to perform methods in accordance with various embodiments of the technology. According to a set of embodiments, some or all of the procedures of such methods are performed by the computer system 700 in response to processor 710 executing one or more sequences of one or more instructions, which might be incorporated into the operating system 740 and/or other code, such as an application program 745, contained in the working memory 735. Such instructions may be read into the working memory 735 from another computer-readable medium, such as one or more of the storage device (s) 725. Merely by way of example, execution of the sequences of instructions contained in the working memory 735 might cause the processor (s) 710 to perform one or more procedures of the methods described herein. Additionally or alternatively, portions of the methods described herein may be executed through specialized hardware.
  • machine-readable medium and “computer-readable medium, ” as used herein, refer to any medium that participates in providing data that causes a machine to operate in a specific fashion.
  • various computer-readable media might be involved in providing instructions/code to processor (s) 710 for execution and/or might be used to store and/or carry such instructions/code
  • a computer-readable medium is a physical and/or tangible storage medium.
  • Such a medium may take the form of a non-volatile media or volatile media.
  • Non-volatile media include, for example, optical and/or magnetic disks, such as the storage device (s) 725.
  • Volatile media include, without limitation, dynamic memory, such as the working memory 735.
  • Common forms of physical and/or tangible computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punchcards, papertape, any other physical medium with patterns of holes, a RAM, a PROM, EPROM, a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read instructions and/or code.
  • Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to the processor (s) 710 for execution.
  • the instructions may initially be carried on a magnetic disk and/or optical disc of a remote computer.
  • a remote computer might load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and/or executed by the computer system 700.
  • the communications subsystem 730 and/or components thereof generally will receive signals, and the bus 705 then might carry the signals and/or the data, instructions, etc. carried by the signals to the working memory 735, from which the processor (s) 710 retrieves and executes the instructions.
  • the instructions received by the working memory 735 may optionally be stored on a non-transitory storage device 725 either before or after execution by the processor (s) 710.
  • configurations may be described as a process which is depicted as a schematic flowchart or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure.
  • examples of the methods may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments to perform the necessary tasks may be stored in a non-transitory computer-readable medium such as a storage medium. Processors may perform the described tasks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Health & Medical Sciences (AREA)
  • Astronomy & Astrophysics (AREA)
  • Computer Graphics (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Traffic Control Systems (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Optical Communication System (AREA)

Abstract

L'invention concerne, selon des modes de réalisation, la facilitation de la vidéoconférence grand angle par un réseau d'UAV. Pour faciliter la vidéoconférence grand angle, des UAV peuvent être employés pour capturer et transmettre des données vidéo au niveau d'emplacements de parties impliquées dans le cadre de la vidéoconférence grand angle. Un ou plusieurs UAV dans le réseau d'UAV peuvent être amenés à localiser l'emplacement de la partie et zoomer sur l'emplacement de la partie. Dans certains exemples, le ou les UAV peuvent être équipés d'une caméra vidéo à 360 degrés de telle sorte qu'une large zone couverte par la vidéo à 360 degrés peut être capturée. Les données vidéo peuvent être transmises à un centre de traitement de données vidéo en temps réel ou sensiblement en temps réel. La transmission de données vidéo par l'UAV donné au centre de traitement de données vidéo peut se faire par le biais d'un réseau d'UAV. Le flux de données vidéo peut être fourni en sortie à un emplacement d'une partie donnée dans le cadre de la vidéoconférence.
PCT/CN2016/113725 2015-12-31 2016-12-30 Facilitation de la vidéoconférence grand angle par un réseau d'uav WO2017114504A1 (fr)

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US201562274112P 2015-12-31 2015-12-31
US62/274,112 2015-12-31
US15/341,813 US9955115B2 (en) 2015-12-31 2016-11-02 Facilitating wide view video conferencing through a drone network
US15/341,824 2016-11-02
US15/341,797 2016-11-02
US15/341,831 US9786165B2 (en) 2015-12-31 2016-11-02 Facilitating location positioning service through a UAV network
US15/341,824 US9826256B2 (en) 2015-12-31 2016-11-02 Facilitating multimedia information delivery through a UAV network
US15/341,831 2016-11-02
US15/341,818 2016-11-02
US15/341,813 2016-11-02
US15/341,797 US10454576B2 (en) 2015-12-31 2016-11-02 UAV network
US15/341,809 US9800321B2 (en) 2015-12-31 2016-11-02 Facilitating communication with a vehicle via a UAV
US15/341,818 US20170193556A1 (en) 2015-12-31 2016-11-02 Facilitating targeted information delivery through a uav network
US15/341,809 2016-11-02

Publications (1)

Publication Number Publication Date
WO2017114504A1 true WO2017114504A1 (fr) 2017-07-06

Family

ID=59165112

Family Applications (6)

Application Number Title Priority Date Filing Date
PCT/CN2016/113592 WO2017114496A1 (fr) 2015-12-31 2016-12-30 Service facilitant une localisation par l'intermédiaire d'un réseau de véhicules aériens sans pilote
PCT/CN2016/113724 WO2017114503A1 (fr) 2015-12-31 2016-12-30 Facilitation de communication avec un véhicule par l'intermédiaire d'un uav
PCT/CN2016/113725 WO2017114504A1 (fr) 2015-12-31 2016-12-30 Facilitation de la vidéoconférence grand angle par un réseau d'uav
PCT/CN2016/113728 WO2017114506A1 (fr) 2015-12-31 2016-12-30 Facilitation de fourniture d'informations multimédia par réseau uav
PCT/CN2016/113726 WO2017114505A1 (fr) 2015-12-31 2016-12-30 Facilitation de la remise d'informations ciblées par le biais d'un réseau d'uav
PCT/CN2016/113718 WO2017114501A1 (fr) 2015-12-31 2016-12-30 Réseau de véhicules aériens sans équipage (uav)

Family Applications Before (2)

Application Number Title Priority Date Filing Date
PCT/CN2016/113592 WO2017114496A1 (fr) 2015-12-31 2016-12-30 Service facilitant une localisation par l'intermédiaire d'un réseau de véhicules aériens sans pilote
PCT/CN2016/113724 WO2017114503A1 (fr) 2015-12-31 2016-12-30 Facilitation de communication avec un véhicule par l'intermédiaire d'un uav

Family Applications After (3)

Application Number Title Priority Date Filing Date
PCT/CN2016/113728 WO2017114506A1 (fr) 2015-12-31 2016-12-30 Facilitation de fourniture d'informations multimédia par réseau uav
PCT/CN2016/113726 WO2017114505A1 (fr) 2015-12-31 2016-12-30 Facilitation de la remise d'informations ciblées par le biais d'un réseau d'uav
PCT/CN2016/113718 WO2017114501A1 (fr) 2015-12-31 2016-12-30 Réseau de véhicules aériens sans équipage (uav)

Country Status (2)

Country Link
CN (9) CN107040754A (fr)
WO (6) WO2017114496A1 (fr)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017119686A1 (de) * 2017-08-28 2019-02-28 Andreas Rheinländer System zur Überwachung, Exploration und Inspektion mittels Drohnen
CN107809277B (zh) * 2017-10-17 2020-02-14 安徽工业大学 一种基于无人机和无线设备的应急救援通信网络组网方法
CN108401501B (zh) * 2017-12-08 2021-10-26 北京小米移动软件有限公司 数据传输方法、装置及无人机
US20190197890A1 (en) * 2017-12-27 2019-06-27 GM Global Technology Operations LLC Methods, systems, and drones for assisting communication between a road vehicle and other road users
CN108471327A (zh) * 2018-03-26 2018-08-31 广东工业大学 一种无人机通信系统
EP3849901A4 (fr) * 2018-09-13 2022-05-18 CommScope Technologies LLC Localisation d'actifs déployés dans des espaces de plafond ou de plancher ou d'autres espaces ou équipements peu commodes à l'aide d'un véhicule sans pilote
WO2020097103A2 (fr) * 2018-11-06 2020-05-14 Battelle Energy Alliance, Llc Systèmes, dispositifs et procédés de communication par ondes millimétriques pour véhicules aériens sans pilote
CN109582036B (zh) * 2018-12-03 2021-04-27 南京航空航天大学 四旋翼无人机一致性编队控制方法
CN110048762A (zh) * 2019-04-23 2019-07-23 南京工业职业技术学院 一种基于太阳能无人机的空中通信网络的实现方法
CN110321951B (zh) * 2019-07-01 2021-03-16 青岛海科虚拟现实研究院 一种vr模拟飞行器训练评价方法
CN110944149A (zh) * 2019-11-12 2020-03-31 上海博泰悦臻电子设备制造有限公司 车辆用儿童看护系统以及方法
CN111865395B (zh) * 2020-06-12 2022-07-05 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 一种面向无人机编队通信的轨迹生成与跟踪方法及系统
CN112906486B (zh) * 2021-01-26 2023-09-12 吉利汽车研究院（宁波）有限公司 无人驾驶出租车的乘客状况检测方法、控制方法及系统
CN114940180A (zh) * 2021-02-10 2022-08-26 华为技术有限公司 一种控制方法及装置
CN112896193B (zh) * 2021-03-16 2022-06-24 四川骏驰智行科技有限公司 一种汽车远程辅助驾驶系统及方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2917134Y (zh) * 2006-03-30 2007-06-27 哈尔滨工程大学 基于dsp的嵌入式实时全景图像采集处理装置
CN102355574A (zh) * 2011-10-17 2012-02-15 上海大学 机载云台运动目标自主跟踪系统的图像稳定方法
US20150092020A1 (en) * 2013-09-27 2015-04-02 Robert L. Vaughn Ambulatory system to communicate visual projections
CN104796611A (zh) * 2015-04-20 2015-07-22 零度智控（北京）智能科技有限公司 移动终端遥控无人机实现智能飞行拍摄的方法及系统
CN105100728A (zh) * 2015-08-18 2015-11-25 零度智控（北京）智能科技有限公司 无人机视频跟踪拍摄系统及方法

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060140644A1 (en) * 2004-12-23 2006-06-29 Paolella Arthur C High performance, high efficiency fiber optic link for analog and RF systems
US9167195B2 (en) * 2005-10-31 2015-10-20 Invention Science Fund I, Llc Preservation/degradation of video/audio aspects of a data stream
US20070131822A1 (en) * 2005-06-20 2007-06-14 Kevin Leigh Taylor Stallard Aerial and ground robotic system
US20080018730A1 (en) * 2006-07-20 2008-01-24 Marc Roth For-hire vehicle interactive communication systems and methods thereof
US7848278B2 (en) * 2006-10-23 2010-12-07 Telcordia Technologies, Inc. Roadside network unit and method of organizing, managing and maintaining local network using local peer groups as network groups
EP2206346A1 (fr) * 2007-10-05 2010-07-14 Panasonic Avionics Corporation Système et procédé de présentation d'un contenu publicitaire sur une plateforme mobile pendant un voyage
US20100162327A1 (en) * 2008-12-18 2010-06-24 Airvod Limited In-Flight Entertainment System
US8515609B2 (en) * 2009-07-06 2013-08-20 Honeywell International Inc. Flight technical control management for an unmanned aerial vehicle
CN101651992B (zh) * 2009-09-18 2011-01-05 北京航空航天大学 一种用于无人飞行器自主编队的数据链组网方法
CN101790248B (zh) * 2009-09-28 2012-06-20 长春理工大学 微型无人机群自治管理数据链路
US9143729B2 (en) * 2010-05-12 2015-09-22 Blue Jeans Networks, Inc. Systems and methods for real-time virtual-reality immersive multimedia communications
CN102006574B (zh) * 2011-01-05 2013-04-24 中国人民解放军理工大学 一种基于无线自组网的一体化异构应急通信网络
JP2012212337A (ja) * 2011-03-31 2012-11-01 Daihatsu Motor Co Ltd 車車間通信装置および車車間通信システム
EP2511656A1 (fr) * 2011-04-14 2012-10-17 Hexagon Technology Center GmbH Système de mesure pour la détermination de coordonnées 3D d'une surface d'objet
US20130002484A1 (en) * 2011-07-03 2013-01-03 Daniel A. Katz Indoor navigation with gnss receivers
DE102011113202A1 (de) * 2011-09-10 2013-03-14 Volkswagen Ag Verfahren zum Betreiben eines Datenempfängers und Datenempfänger, insbesondere in einem Fahrzeug
CN102436738B (zh) * 2011-09-26 2014-03-05 同济大学 一种基于无人机的交通监测装置
US9082239B2 (en) * 2012-03-14 2015-07-14 Flextronics Ap, Llc Intelligent vehicle for assisting vehicle occupants
EP2829059A1 (fr) * 2012-03-19 2015-01-28 Sony Mobile Communications AB Visioconférence faisant intervenir un dispositif de visioconférence périphérique sans fil
US11328325B2 (en) * 2012-03-23 2022-05-10 Secureads, Inc. Method and/or system for user authentication with targeted electronic advertising content through personal communication devices
CN102654940B (zh) * 2012-05-23 2014-05-14 上海交通大学 基于无人驾驶飞机的交通信息采集系统的信息处理方法
KR101393539B1 (ko) * 2012-09-17 2014-05-09 기아자동차 주식회사 자동차 통합 네트워크 시스템
US8971274B1 (en) * 2012-11-09 2015-03-03 Google Inc. Valuation of and marketplace for inter-network links between balloon network and terrestrial network
CN103116994B (zh) * 2012-12-28 2015-01-07 方科峰 光通讯的交通系统及交通系统管理方法
WO2014179235A1 (fr) * 2013-04-29 2014-11-06 Oceus Networks Inc. Liaison de réseau cellulaire mobile
US9070289B2 (en) * 2013-05-10 2015-06-30 Palo Alto Research Incorporated System and method for detecting, tracking and estimating the speed of vehicles from a mobile platform
CN103280108B (zh) * 2013-05-20 2015-04-22 中国人民解放军国防科学技术大学 基于视觉感知和车联网的客车安全预警系统
US9085370B2 (en) * 2013-06-03 2015-07-21 General Electric Company Systems and methods for wireless data transfer during in-flight refueling of an aircraft
US9503694B2 (en) * 2013-08-13 2016-11-22 GM Global Technology Operations LLC Methods and apparatus for utilizing vehicle system integrated remote wireless image capture
CN103413444B (zh) * 2013-08-26 2015-08-19 深圳市川大智胜科技发展有限公司 一种基于无人机高清视频的交通流调查处理方法
CN203596823U (zh) * 2013-09-24 2014-05-14 中国航天空气动力技术研究院 一种无人机高空基站通信系统
US20150134143A1 (en) * 2013-10-04 2015-05-14 Jim Willenborg Novel tracking system using unmanned aerial vehicles
US20150127460A1 (en) * 2013-11-04 2015-05-07 Vixs Systems Inc. Targeted advertising based on physical traits and anticipated trajectory
CN103780313A (zh) * 2014-01-21 2014-05-07 桂林航天光比特科技股份公司 飞行器激光供能通讯系统
US20150271452A1 (en) * 2014-03-21 2015-09-24 Ford Global Technologies, Llc Vehicle-based media content capture and remote service integration
CN103914076B (zh) * 2014-03-28 2017-02-15 浙江吉利控股集团有限公司 一种基于无人机的货物传送系统和方法
CN103985230B (zh) * 2014-05-14 2016-06-01 深圳市大疆创新科技有限公司 一种基于图像的通知方法、装置及通知系统
US9334052B2 (en) * 2014-05-20 2016-05-10 Verizon Patent And Licensing Inc. Unmanned aerial vehicle flight path determination, optimization, and management
US20150355309A1 (en) * 2014-06-05 2015-12-10 University Of Dayton Target tracking implementing concentric ringlets associated with target features
JP6784434B2 (ja) * 2014-07-30 2020-11-11 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドＳｚ Ｄｊｉ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．，Ｌｔｄ 方法、ｕａｖ制御プログラム、無人航空機、及び制御システム
CN104168455B (zh) * 2014-08-08 2018-03-09 北京航天控制仪器研究所 一种空基大场景摄像系统及方法
US9170117B1 (en) * 2014-08-21 2015-10-27 International Business Machines Corporation Unmanned aerial vehicle navigation assistance
CN104394472B (zh) * 2014-11-21 2018-08-03 成都亿盟恒信科技有限公司 一种3g车载无线视频娱乐点播系统及方法
CN104699102B (zh) * 2015-02-06 2017-07-18 东北大学 一种无人机与智能车协同导航与侦查监控系统及方法
CN104766481A (zh) * 2015-04-29 2015-07-08 深圳市保千里电子有限公司 一种无人机进行车辆跟踪的方法及系统
CN104881650A (zh) * 2015-05-29 2015-09-02 成都通甲优博科技有限责任公司 一种基于无人机动平台的车辆跟踪方法
CN105139606B (zh) * 2015-07-29 2019-04-02 重庆赛乐威航空科技有限公司 一种低空飞行器信息交互系统
CN105119650B (zh) * 2015-08-24 2018-03-02 杨珊珊 基于无人飞行器的信号中继系统及其信号中继方法
CN204887278U (zh) * 2015-09-15 2015-12-16 成都时代星光科技有限公司 无人机空中自组网图像传输系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2917134Y (zh) * 2006-03-30 2007-06-27 哈尔滨工程大学 基于dsp的嵌入式实时全景图像采集处理装置
CN102355574A (zh) * 2011-10-17 2012-02-15 上海大学 机载云台运动目标自主跟踪系统的图像稳定方法
US20150092020A1 (en) * 2013-09-27 2015-04-02 Robert L. Vaughn Ambulatory system to communicate visual projections
CN104796611A (zh) * 2015-04-20 2015-07-22 零度智控（北京）智能科技有限公司 移动终端遥控无人机实现智能飞行拍摄的方法及系统
CN105100728A (zh) * 2015-08-18 2015-11-25 零度智控（北京）智能科技有限公司 无人机视频跟踪拍摄系统及方法

Also Published As

Publication number Publication date
CN206481394U (zh) 2017-09-08
CN107070531A (zh) 2017-08-18
WO2017114496A1 (fr) 2017-07-06
WO2017114506A1 (fr) 2017-07-06
WO2017114505A1 (fr) 2017-07-06
CN206517444U (zh) 2017-09-22
CN106878672A (zh) 2017-06-20
WO2017114501A1 (fr) 2017-07-06
CN107040754A (zh) 2017-08-11
WO2017114503A1 (fr) 2017-07-06
CN107071794A (zh) 2017-08-18
CN106982345A (zh) 2017-07-25
CN208401845U (zh) 2019-01-18
CN107046710A (zh) 2017-08-15

Similar Documents

Publication Publication Date Title
US10440323B2 (en) Facilitating wide view video conferencing through a drone network
WO2017114504A1 (fr) Facilitation de la vidéoconférence grand angle par un réseau d'uav
US10454564B2 (en) Facilitating communication with a vehicle via a UAV
US10097862B2 (en) Facilitating multimedia information delivery through a UAV network
US10354521B2 (en) Facilitating location positioning service through a UAV network
EP3188474A1 (fr) Facilitation de la distribution ciblée d'informations dansun réseau d'uav
JP4763610B2 (ja) ビデオオンデマンド方法及び装置
US20160309124A1 (en) Control system, a method for controlling an uav, and a uav-kit
US20200106818A1 (en) Drone real-time interactive communications system
WO2016171160A1 (fr) Système de transmission sonore
US20200126413A1 (en) Uav network assisted situational self-driving
US20210294327A1 (en) System and method for movable object control
CN107872656A (zh) 监控系统及指挥系统
WO2012127189A1 (fr) Appareil et système d'acquisition d'image
US11304161B2 (en) Systems and methods for synchronizing multiple control devices with a movable object

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16881293

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 08.10.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16881293

Country of ref document: EP

Kind code of ref document: A1