WO2017160381A1 - Système pour flux vidéo en temps réel géoréférencés et géo-orientés - Google Patents

Système pour flux vidéo en temps réel géoréférencés et géo-orientés Download PDF

Info

Publication number
WO2017160381A1
WO2017160381A1 PCT/US2017/000020 US2017000020W WO2017160381A1 WO 2017160381 A1 WO2017160381 A1 WO 2017160381A1 US 2017000020 W US2017000020 W US 2017000020W WO 2017160381 A1 WO2017160381 A1 WO 2017160381A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
video
stream
location
computer
Prior art date
Application number
PCT/US2017/000020
Other languages
English (en)
Inventor
Evangelos FOUTZITZIS
Javier SANTORO
Original Assignee
Adcor Magnet Systems, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Adcor Magnet Systems, Llc filed Critical Adcor Magnet Systems, Llc
Priority to EP17767092.4A priority Critical patent/EP3430591A4/fr
Publication of WO2017160381A1 publication Critical patent/WO2017160381A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • TITLE SYSTEM FOR GENERATING GEOREFERENCED, GEO-ORIENTED REALTIME VIDEO STREAMS INVENTORS: Evangelos FOUTZITZIS and Javier SANTORO ASSIGNEE: ADCOR MAGnet Systems, LLC PRIORITY
  • the present invention relates generally to remote imaging and to geographic information systems, and more particularly, to a system for generating georeferenced, geo-oriented realtime video streams.
  • “Georeferencing” generally means associating an object with coordinates in a reference system, for example latitude, longitude, and elevation, also referred to as location metadata.
  • Geo-orienting generally refers to the action of orienting an object relative to the points of a magnetic or digital compass or other specified positions.
  • Geo-orientation refers to the process of displaying the said object as a different layer on a computer generated map with specific compass bearing, roll and pitch angles to superimpose its exact attitude with regards to the geographic environment, and permitting a user to control the viewpoint from which the combined image is viewed.
  • GPS Global Positioning Systems
  • GIS Geographical Information Systems
  • Google ® Earth allows rendering a map of a given location and also allows display of icons or images representing
  • the images used by Google ® Earth are historical, representing the appearance as of the last time that particular location was captured for the Google database.
  • Remote video acquisition may be accomplished using various platforms, including satellites, drones, unmanned aerial vehicles, remote-controlled cameras or cell phones.
  • U. S. Patents have been directed to visualization of remotely acquired images or geospatial information.
  • U. S. Patent 6,484,101 generates geo-spatial objects which are assigned location data and represented on a map. It does not, however, disclose or suggest projecting realtime geo- referenced video feeds on the map nor does it disclose or suggest 3-Dimensional representations.
  • U. S. Patent 8,997,521 discloses 3-Dimensional models on a map. It does not, however, disclose or suggest realtime projection or video projection.
  • U. S. Patent 8,942,483 compares still, non-georeferenced, images against georeferenced images included in a database of georeferenced imagery. If a match is found, then it outputs a correlation identifier stating that a match has been found and that the location of the non-georeferenced imagery has been resolved; i.e. it is used to identify the location at which a particular image has been taken if that location's imagery is in a preexisting database. It does not, however, disclose or suggest realtime projection or video projection.
  • U. S. Patent 9,091,547 teaches simulation of the view of the ground an airborne observer will have at a specific location and orientation. It does not, however, disclose or suggest realtime projection or video projection nor does it teach realtime sensor data fusion.
  • U. S. Patent 9,188,444 teaches a system for improving the location accuracy of an object that appears on a georeferenced image. It does not, however, disclose or suggest projecting realtime 3-Dimensional georeferenced video feeds on a map.
  • U. S. Patent 9,218,682 uses a database of georeferenced objects and embeds geo-location information from matching images. It does not, however, disclose or suggest projecting 3-Dimensional realtime georeferenced video feeds on a map.
  • the invention comprises a system for placing remotely acquired video in context by creating a hybrid video, combining the realtime remotely acquired video with real time sensor data representing the geography of the location and 3-Dimentional attitude at which the video was acquired, and allowing a user to control the viewpoint from which the hybrid image is displayed, thereby generating 3-Dimensional, georeferenced, geo-oriented realtime imagery, including video imagery.
  • the system comprises means for acquiring a remote image, for example a video camera, which captures a real time data feed (which may be single frames or continuous and which may be visible or in a portion of the electromagnetic spectrum not visible to the human eye); a global positioning system (“GPS") receiver, which reports location metadata associated with the video camera at each instant during image capture; means for determining the orientation of the video camera, for example a 3-Axis compass, which captures the orientation metadata (for example, heading, roll and pitch angles) associated with the video camera at each instant while the video feed is being captured; a computer system on which is stored a database of geographic location metadata and associated imagery for a region of interest and software for fusing images from the realtime video feed with the geographic location metadata and associated imagery and generating a signal which may be translated into a hybrid image for visual display, and a network which connects the system components.
  • the system generates geo-referenced, geo-oriented live footage.
  • Figure 1 shows a prototype of the remote portion of the system.
  • Figure 1(a) is a schematic of the prototype of Figure 1 identifying the main components.
  • Figure 2 is a flow chart of the system.
  • Figure 3 is a flowchart of an element of software for processing remote imagery.
  • Figure 4 is an example of two images created by the system, a flat projection and a cylindrical projection.
  • Figure 4(a) is a line drawing showing select features of the flat projection of the image of Figure 4.
  • Figure 4(b) is a line drawing showing select features of the cylindrical projection of Figure 4.
  • Figure 4(c) is a line drawing showing select features of an alternative (spherical) projection of the image of Figure 4 projected as a spherical projection.
  • Figure 5 is a schematic of an example of a system suitable for carrying acquiring the two data streams required by the invention.
  • Figure 6 is a high-level schematic showing the principal components of the system and their interaction.
  • Figure 7 is a flow chart of software suitable for implementing the invention.
  • Figure 8 is a representation of experimental data fusing prestored geographical information with a live video feed and environmental data.
  • a “topographical image” comprises data describing historical or fixed information concerning the general location under consideration and may include data in the form of imagery (which may include images in spectral ranges beyond human vision), geolocation tags (for example, latitude, longitude and elevation) and would typically be acquired ahead of time and stored on a storage medium and organized as a database accessible by a computer.
  • a "realtime image” comprises data acquired in real time (or at a specific time) and may, in addition to visual images, include images in spectral ranges beyond human vision, geolocation tags describing the location of the image being captured and/or the device capturing the image. Examples of geolocation tags would include latitude, longitude and altitude or elevation of either the device capturing the realtime image or of components of the image, and attitude of the device with respect to a specific plane (for example, a real or artificial horizon) and orientation with respect to a reference (for example, geographic north).
  • the system of the invention generates georeferenced, geo-oriented live imagery using a video camera, which is used for capturing a real time video feed- a global positioning system (“GPS") receiver, which is used to establish and update the location metadata associated with the video camera at each instant during the time the video feed is being captured; a 3-Axis compass, which is used to capture the orientation metadata (for example, heading, roll and pitch angles) associated with the video camera at each instant while the video feed is being captured; a computer system on which is stored a database of geographic location metadata and associated imagery for a region of interest and software for fusing images from the realtime video feed with the geographic location metadata and associated imagery and generating a signal which may be translated into a hybrid image for visual display, and a network which connects the video camera, the GPS, the 3-axis compass and the computer system.
  • GPS global positioning system
  • the network may be wired (for example, a router connected with the video camera, the 3-axis compass and the computer system) or may be wireless (for example, a cellular modem connected with the video camera, the 3-axis compass and the computer system).
  • the system generates geo-referenced, geo-oriented live footage.
  • the components may in one embodiment be integrated into a single device, for example, into a smartphone that carries a camera, a cellular modem, a GPS and a compass.
  • the components are connected by a network, for example the internet.
  • the remote portion of the system comprises a GPS receiver (item #1) and a digital 3-Axis compass (item #2) which are aligned with a camera (item #3) focal point to generate and transmit the location and orientation respectively of a video stream being acquired by the camera.
  • the remote computer receives the aforementioned data, and is programmed to generate the 3-Dimensional imagery and display it as a separate layer on top of prestored digital maps to the true location and orientation at which the imagery was acquired under software control.
  • Writing the software for calculation, display and coordination of the 3-dimensional imagery and prestored digital maps is a time- consuming task, but requires no more than receiving the data and using it as the input to trigonometry calculations which are within the skill of those of ordinary skill in the art.
  • the software is responsive to user control specifying which images are of interest (location and viewpoint). Again, creation of such software is within the skill of those of ordinary skill in the art.
  • the software should allow a user to obtain a topographical image of an area of interest and provide indexed access to the image to a computer.
  • the indexing should be designed so as to enable the computer to access a particular subset of the topographical image in response to an input from the user, using a database management system.
  • the topographical image may, for example, be Google ® Earth and the computer access may be through the internet using a browser, for example, Firefox.
  • the user determines a specific realtime image of interest and deploys a remote-controlled video camera system, illustrated in Figure 1, to the location of the realtime image, for example by using a drone carrying a video camera, a remote control device, a GPS device, a clock (which may be a component of the GPS device) a 3-Axis compass and a cellular modem with access to a network.
  • a drone carrying a video camera, a remote control device, a GPS device, a clock (which may be a component of the GPS device) a 3-Axis compass and a cellular modem with access to a network.
  • the user activates and orients the video camera toward a location of interest using the remote control device.
  • the user uses the remote control device to activate a data feed (comprising a frame-by-frame time-stamped topographical image acquired by the video camera, and the location of the video camera acquired by the GPS device and the orientation of the video camera acquired by the 3-Axis compass) from the cellular modem, over the network, to the computer, where it is stored.
  • Software running on the computer retrieves the topographical image related to the area from which the realtime image is being captured and the realtime image and, in response to user input designating the viewpoint which the user desires, combines the topographical image and the realtime image by placing the realtime image in the appropriate location and orientation of the topographical image.
  • the placement may be determined using standard trigonometry and geometry using as inputs the location and orientation information transmitted to the computer.
  • the system thereby generates a georeferenced, geo-oriented realtime hybrid image comprising the fused topographical images and realtime images, which may then be displayed on a monitor, printed or otherwise conveyed to the user.
  • An example of such a fused image is shown in Figure 2.
  • additional metadata for example, the time the image was captured, the location of the camera or of the object being captured, the altitude of the camera, the elevation of various components of the topography or the attitude of the camera
  • the system consists of:
  • a remote package comprising: 1. A platform suitable for mounting the components of the remote package; to which the following are mounted:
  • a camera The camera can be of any suitable type, for example a simple Pan-Tilt-Zoom (PTZ) camera or a Fish-Eye camera or a Spherical camera.
  • the projection type is governed by the type of camera used.
  • a PTZ camera uses a planar image plane.
  • a Fish-eye camera uses a cylindrical image plane, while a spherical camera uses a spherical image plane.
  • Cameras are characterized in terms of focal length, horizontal and vertical field of view (FoV) and image size.
  • An internal parameter of detector size may be used in computations, but its value is derived from FoV and image size.
  • a ground or projection surface which is imaged by camera.
  • a ground surface is defined in terms of its distance from camera and is always a plane surface that is being imaged.
  • a GPS and 3-Axis compass which together are capable of determining the location and orientation of the camera (for example, Pan, Tilt and Yaw)
  • Transmission capability for example a cellular modem, capable of transmitting the data collected by the camera, GPS and to a remote computer for processing and display.
  • a transmission system comprising:
  • a receiver capable of receiving the transmitted data, coupled to a computer.
  • a computer processing system comprising:
  • the user provides the GIS data in a form readable by the computer and deploys the remote package to an area of interest.
  • the remote package acquires realtime video of the area of interest and associated location and orientation information and transmits it to the computer.
  • the computer executes software which calculates and displays a fused image incorporating the GIS data and the realtime video.
  • a suitable projection may be based on ray tracing. It computes both ground coordinates and above ground bearing vectors that corresponds to any image point. First a 3D look vector is computed that joins the image point and the camera optical centre. This is known as camera internal orientation that is computed. A projection is calculated as a function of camera parameters. Next, a 3D rotation matrix is computed that take into account rotation of mount (Base roll, pitch and yaw), as well as camera orientation (Pan and tilt).
  • This 3D rotation matrix is combined with look vector to orient the look vector in real earth.
  • a lookVectorl ray that emerges from image location and hit the earth after passing through optical center. This vector is oriented in real earth as per orientation of UAV and camera. The look vector is projected to its target object or earth. Knowing the distance of UAV or camera from earth it is possible to calculate the exact distance along this line to hit the ground.
  • a device for example a
  • the smartphone or a camera with suitable environmental sensors is used to simultaneously acquire a stream of video information and an associated stream of environmental information (for example, location, altitude, attitude, and other desired information).
  • the two streams are multiplexed so as to create a multiplexed stream of information, which is transmitted (for example, using wifi or the cellular modem of a smart phone) to a remote location where a user has a computer with a receiver capable of receiving said multiplexed stream, a processor capable of demultiplexing said multiplexed stream back into the original stream of video information and stream of environmental information and converting them into a visually display.
  • the multiplexed stream is separated into a stream of video information and a stream of environmental information.
  • the computer is provided with memory and software capable of providing access to a pre-stored database of topographical information and database management software.
  • the computer is instructed to access the topographical information associated with the location from which the stream of video information was captured as identified by the stream of environmental information. This allows the computer to determine the location from which the stream of video information was captured and the point of view of the device which captured it (location in space, attitude and any other desired information) and to construct a virtual map fusing the topographical information with the stream of video information so as to allow a user to view the stream of video information in the context of, and from the desired point of view of, a virtual observer located at a selected point and viewpoint on the virtual map.
  • FIG 4 illustrates a conceptual visualization of the fused image data.
  • the realtime video streams may be visualized in a number of ways, including as a flat projection as shown in Figure 4(a), as a cylindrical projection as shown in Figure 4(b) or as a spherical projection as shown in Figure 4( c); other projections could be used for specialized purposes, using geometry and programming that would be within the level of skill of those of ordinary skill in the art.
  • the system may utilize the live video streaming capability of a smartphone coupled with a "geo- registration" component so as to create a streamed video that has location and orientation data embedded to it as video metadata.
  • the location and orientation data may be extracted from the an embedded GPS (for location), compass, accelerometers and gyros (for orientation) if the smartphone is so equipped, or may be acquired from external equipment.
  • Figure 5 illustrates a suitable smartphone, incorporating an image sensor (camera), a location sensor (gps), multiple orientation sensors (gyroscope, compass, accelerometers) and a microprocessor.
  • the combined streamed video therefore differs from, for example, video chat and video conferencing applications, in that it is enriched with location and orientation data.
  • This enriched footage is streamed then over WiFi and/or cellular networks to a client, which may be another smartphone, a tablet, a server, a laptop, a desktop or other device.
  • Figure 6 illustrates the process in overview. Note that location and orientation data are combined with live video from a camera using a smartphone's microprocessor to create a single data package which may be streamed wirelessly over the internet or using wif i or the smartphone's cellular connection.
  • Figure 7 provides a flow chart of software suitable for controlling the various components and carrying out the invention. Note that a remote server resolves addressing between the serving devices which stream the multiplexed streams and one or more client devices which receive the multiplexed stream and process it for display.
  • a pairing application separates the received location/orientation data from the video and uses them to render an invisible frame onto a digital map that follows the same orientation in all 3-axis as the smartphone attitude used to generate this attitude. Also, the GPS information are used so this invisible frame is placed on the exact location where the smartphone resides.
  • the application textures the invisible frame with the received video frames so that the video is geo-registered and geo-oriented by presenting it on a digital map at the location of and oriented from the perspective of the smartphone which was used to generate the video.
  • Data acquisition is carried out by using the smartphone's camera to acquire the desired video and the smartphone's positioning features (to the extent present or as supplemented by additional hardware) to acquire environmental data (for example, gps positioning, altitude, attitude - pan, tilt, roll-, acceleration or other data of interest to the user).
  • environmental data for example, gps positioning, altitude, attitude - pan, tilt, roll-, acceleration or other data of interest to the user.
  • Telemetry begins with multiplexing the acquired data with the video stream.
  • the multiplexed data is then transmitted - for example, using wifi or cellular - as a transmission stream to a client location.
  • the transmission stream is de-multiplexed so as to separate it into a video stream and an environmental stream.
  • the environmental data is parsed and processed so as to display the location of the smartphone on a map at a location and with its orientation corresponding to the environmental data, and also to display the 3D projection of the live video stream both flat video (FOV less than 180) or spherical video (FOV greater than 180) at the correct "projected" location and FOV from the location of the phone's camera on the 3D map. All this information is streamed and updated real time so that the user of the client applications can "follow" the smartphone it is connected to and see the changes in location, attitude and video on the map.
  • Display may be controlled by the user extracting each video frame as it arrives real time and selecting a display mode. If the video is flat (less than 180 degrees field of view) then the video is shown on the map as a flat rectangular frame. The location and "attitude" of this frame on the 3D map is calculated using the environmental data from the phone. Knowing the phone location and the camera FOV angles the flat rectangular frame can be drawn at the appropriate location on the map. This location/attitude changes real time with the location/attitude of the phone. The user may also change its point of view around the map and locate itself at the phone location to have the POV of the video from the location of the phone itself.
  • the processing is more complicated.
  • the basic process is to create a virtual 3D "hemisphere" centered at the location of the phone and taking into consideration the phones attitude and camera FOV angles.
  • This hemisphere is a "wire frame” and its surface consists of many vertices / triangles. The higher the number of vertices and triangles the smoother the appearance of the sphere on the display (the "wire frame” is not shown on the display).
  • the hemisphere location/attitude is, once again, updated real time from the phone data.
  • the fisheye video frames that are being received real time from the phone's camera are "textured/draped" over the hemisphere wire frame so that the user sees the live video as a 3D sphere on the map.
  • the fisheye video frames from the camera cannot be applied directly as a texture to the hemisphere but need to be "de-warped / stretched" over the hemisphere wire frame. All this occurs real time on the client device (which may be a PC, another cell phone, a tablet, a server, a desktop computer or other device).
  • Figure 8 illustrates a suitable display system displaying a live video feed fused to prestored terrain information and location and attitude information of the sensor generating the live video feed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Remote Sensing (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne un système qui crée une image composite en temps réel/géospatiale, géo-orientée, géoréférencée, par combinaison de données géographiques stockées au préalable avec des flux vidéo en temps réel et des données d'état caractérisant la source du flux vidéo en temps réel, et affiche visuellement l'image composite sous la commande en temps réel d'un utilisateur.
PCT/US2017/000020 2016-03-16 2017-03-13 Système pour flux vidéo en temps réel géoréférencés et géo-orientés WO2017160381A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP17767092.4A EP3430591A4 (fr) 2016-03-16 2017-03-13 Système pour flux vidéo en temps réel géoréférencés et géo-orientés

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
USNONE 2003-06-11
US201662390021P 2016-03-16 2016-03-16
US62/390,021 2016-03-16

Publications (1)

Publication Number Publication Date
WO2017160381A1 true WO2017160381A1 (fr) 2017-09-21

Family

ID=59851806

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/000020 WO2017160381A1 (fr) 2016-03-16 2017-03-13 Système pour flux vidéo en temps réel géoréférencés et géo-orientés

Country Status (2)

Country Link
EP (1) EP3430591A4 (fr)
WO (1) WO2017160381A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110704556A (zh) * 2019-09-03 2020-01-17 镇江市勘察测绘研究院 一种基于gis技术的地理信息采集方法
CN115546377A (zh) * 2022-12-01 2022-12-30 杭州靖安科技有限公司 一种视频融合方法、装置、电子设备及存储介质
WO2023029588A1 (fr) * 2021-08-30 2023-03-09 成都纵横自动化技术股份有限公司 Procédé de présentation de vidéo dynamique appliqué à gis et son système

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100268458A1 (en) * 2009-04-20 2010-10-21 Honeywell International Inc. Enhanced vision system for precision navigation in low visibility or global positioning system (gps) denied conditions
US20110119711A1 (en) * 2009-10-08 2011-05-19 Marshall Communications Multimedia Content Fusion
US20110141254A1 (en) * 2009-11-17 2011-06-16 Roebke Mark J Systems and methods for augmented reality
US20120293505A1 (en) * 2004-08-31 2012-11-22 Meadow William D Three dimensional image data models
US20130208001A1 (en) * 2008-11-04 2013-08-15 United States Of America, As Represented By The Secretary Of The Navy Composable Situational Awareness Visualization System
US20140267723A1 (en) * 2013-01-30 2014-09-18 Insitu, Inc. Augmented video system providing enhanced situational awareness
US20150221079A1 (en) * 2014-01-31 2015-08-06 Pictometry International Corp. Augmented Three Dimensional Point Collection of Vertical Structures

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8477190B2 (en) * 2010-07-07 2013-07-02 Pictometry International Corp. Real-time moving platform management system
EP2619605A1 (fr) * 2010-09-23 2013-07-31 Telefónica, S.A. Procédé et système de calcul de la géolocalisation d'un dispositif personnel

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120293505A1 (en) * 2004-08-31 2012-11-22 Meadow William D Three dimensional image data models
US20130208001A1 (en) * 2008-11-04 2013-08-15 United States Of America, As Represented By The Secretary Of The Navy Composable Situational Awareness Visualization System
US20100268458A1 (en) * 2009-04-20 2010-10-21 Honeywell International Inc. Enhanced vision system for precision navigation in low visibility or global positioning system (gps) denied conditions
US20110119711A1 (en) * 2009-10-08 2011-05-19 Marshall Communications Multimedia Content Fusion
US20110141254A1 (en) * 2009-11-17 2011-06-16 Roebke Mark J Systems and methods for augmented reality
US20140267723A1 (en) * 2013-01-30 2014-09-18 Insitu, Inc. Augmented video system providing enhanced situational awareness
US20150221079A1 (en) * 2014-01-31 2015-08-06 Pictometry International Corp. Augmented Three Dimensional Point Collection of Vertical Structures

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3430591A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110704556A (zh) * 2019-09-03 2020-01-17 镇江市勘察测绘研究院 一种基于gis技术的地理信息采集方法
WO2023029588A1 (fr) * 2021-08-30 2023-03-09 成都纵横自动化技术股份有限公司 Procédé de présentation de vidéo dynamique appliqué à gis et son système
CN115546377A (zh) * 2022-12-01 2022-12-30 杭州靖安科技有限公司 一种视频融合方法、装置、电子设备及存储介质
CN115546377B (zh) * 2022-12-01 2023-04-18 杭州靖安科技有限公司 一种视频融合方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
EP3430591A4 (fr) 2019-11-27
EP3430591A1 (fr) 2019-01-23

Similar Documents

Publication Publication Date Title
US20180262789A1 (en) System for georeferenced, geo-oriented realtime video streams
US10186075B2 (en) System, method, and non-transitory computer-readable storage media for generating 3-dimensional video images
US11423586B2 (en) Augmented reality vision system for tracking and geolocating objects of interest
US20200154049A1 (en) Digital 3d/360 degree camera system
US10403044B2 (en) Telelocation: location sharing for users in augmented and virtual reality environments
US8633970B1 (en) Augmented reality with earth data
US9240074B2 (en) Network-based real time registered augmented reality for mobile devices
US20170094227A1 (en) Three-dimensional spatial-awareness vision system
US20190088025A1 (en) System and method for authoring and viewing augmented reality content with a drone
JP5093053B2 (ja) 電子カメラ
US20120019522A1 (en) ENHANCED SITUATIONAL AWARENESS AND TARGETING (eSAT) SYSTEM
US20120246223A1 (en) System and method for distributing virtual and augmented reality scenes through a social network
US9756260B1 (en) Synthetic camera lenses
KR20210104684A (ko) 측량 및 매핑 시스템, 측량 및 매핑 방법, 장치 및 기기
EP2685707A1 (fr) Système de tir vidéo sphérique
US10616483B1 (en) Apparatus and method of generating electronic three-dimensional walkthrough environment
WO2018193574A1 (fr) Procédé de production de trajectoire de vol, dispositif de traitement d'informations, système de production de trajectoire de vol, programme et support d'enregistrement
CN102831816B (zh) 一种提供实时场景地图的装置
CN107966136B (zh) 基于主无人机视觉的从无人机位置显示方法、装置及系统
US20240087157A1 (en) Image processing method, recording medium, image processing apparatus, and image processing system
WO2017160381A1 (fr) Système pour flux vidéo en temps réel géoréférencés et géo-orientés
CN109712249B (zh) 地理要素增强现实方法及装置
JP2019135605A (ja) 撮影映像表示装置及び撮影映像表示方法
JP2016122277A (ja) コンテンツ提供サーバ、コンテンツ表示端末、コンテンツ提供システム、コンテンツ提供方法、および、コンテンツ表示プログラム
Yang et al. Seeing as it happens: Real time 3D video event visualization

Legal Events

Date Code Title Description
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017767092

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017767092

Country of ref document: EP

Effective date: 20181015

ENP Entry into the national phase

Ref document number: 2017767092

Country of ref document: EP

Effective date: 20181016

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17767092

Country of ref document: EP

Kind code of ref document: A1