[go: up one dir, main page]

SG11202005399WA - Image based localization for unmanned aerial vehicles, and associated systems and methods - Google Patents

Image based localization for unmanned aerial vehicles, and associated systems and methods

Info

Publication number
SG11202005399WA
SG11202005399WA SG11202005399WA SG11202005399WA SG11202005399WA SG 11202005399W A SG11202005399W A SG 11202005399WA SG 11202005399W A SG11202005399W A SG 11202005399WA SG 11202005399W A SG11202005399W A SG 11202005399WA SG 11202005399W A SG11202005399W A SG 11202005399WA
Authority
SG
Singapore
Prior art keywords
methods
unmanned aerial
image based
aerial vehicles
associated systems
Prior art date
Application number
SG11202005399WA
Inventor
Dinuka Abeywardena
Damien Jourdan
Original Assignee
Wing Aviation Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wing Aviation Llc filed Critical Wing Aviation Llc
Publication of SG11202005399WA publication Critical patent/SG11202005399WA/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804Creation or updating of map data
    • G01C21/3833Creation or updating of map data characterised by the source of data
    • G01C21/3852Data derived from aerial or satellite images
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3863Structures of map data
    • G01C21/387Organisation of map data, e.g. version management or database structures
    • G01C21/3881Tile-based structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/13Satellite images
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft
    • G08G5/20Arrangements for acquiring, generating, sharing or displaying traffic information
    • G08G5/26Transmission of traffic-related information between aircraft and ground stations
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft
    • G08G5/30Flight plan management
    • G08G5/34Flight plan management for flight plan modification
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft
    • G08G5/50Navigation or guidance aids
    • G08G5/55Navigation or guidance aids for a single aircraft
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft
    • G08G5/50Navigation or guidance aids
    • G08G5/57Navigation or guidance aids for unmanned aircraft
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G5/00Traffic control systems for aircraft
    • G08G5/70Arrangements for monitoring traffic-related situations or conditions
    • G08G5/74Arrangements for monitoring traffic-related situations or conditions for monitoring terrain
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00UAVs specially adapted for particular uses or applications
    • B64U2101/30UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Astronomy & Astrophysics (AREA)
  • Navigation (AREA)
  • Studio Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
SG11202005399WA 2017-12-21 2018-12-13 Image based localization for unmanned aerial vehicles, and associated systems and methods SG11202005399WA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762609135P 2017-12-21 2017-12-21
US15/963,027 US10685229B2 (en) 2017-12-21 2018-04-25 Image based localization for unmanned aerial vehicles, and associated systems and methods
PCT/US2018/065563 WO2019125921A1 (en) 2017-12-21 2018-12-13 Image based localization for unmanned aerial vehicles, and associated systems and methods

Publications (1)

Publication Number Publication Date
SG11202005399WA true SG11202005399WA (en) 2020-07-29

Family

ID=66950468

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202005399WA SG11202005399WA (en) 2017-12-21 2018-12-13 Image based localization for unmanned aerial vehicles, and associated systems and methods

Country Status (7)

Country Link
US (1) US10685229B2 (en)
EP (1) EP3729227B1 (en)
CN (1) CN111492326B (en)
AU (2) AU2018388887B2 (en)
FI (1) FI3729227T3 (en)
SG (1) SG11202005399WA (en)
WO (1) WO2019125921A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113110591B (en) * 2017-11-03 2023-02-28 深圳市道通智能航空技术股份有限公司 Method for setting flight path of unmanned aerial vehicle, terminal and unmanned aerial vehicle
US10690525B2 (en) * 2018-01-03 2020-06-23 General Electric Company Systems and methods associated with unmanned aerial vehicle targeting accuracy
US11100667B2 (en) * 2019-10-30 2021-08-24 Wing Aviation Llc Systems and methods for generating annotations of structured, static objects in aerial imagery using geometric transfer learning and probabilistic localization
US11244500B2 (en) 2019-12-31 2022-02-08 Woven Planet North America, Inc. Map feature extraction using overhead view images
US11037328B1 (en) 2019-12-31 2021-06-15 Lyft, Inc. Overhead view image generation
US11288522B2 (en) 2019-12-31 2022-03-29 Woven Planet North America, Inc. Generating training data from overhead view images
CN115699134A (en) * 2020-06-27 2023-02-03 深圳市大疆创新科技有限公司 Techniques for using compact payload mapping in a movable object environment
CN112487894B (en) * 2020-11-17 2024-04-23 厦门路桥信息股份有限公司 Automatic track traffic protection area inspection method and device based on artificial intelligence
CN112349150B (en) * 2020-11-19 2022-05-20 飞友科技有限公司 Video acquisition method and system for airport flight guarantee time node
US20220197893A1 (en) * 2020-12-23 2022-06-23 Here Global B.V. Aerial vehicle and edge device collaboration for visual positioning image database management and updating
US11907888B2 (en) 2020-12-23 2024-02-20 Here Global B.V. Aerial vehicle and computing device interaction for validating aerial vehicle activity
CN112837378B (en) * 2021-02-03 2024-04-30 江南大学 Aerial camera attitude external dynamic calibration and mapping method based on multi-unmanned aerial vehicle formation
CN114182663B (en) * 2021-11-26 2023-06-20 深圳市智泊云科技有限公司 Parking management device for high-definition license plate recognition
US20230316741A1 (en) * 2022-03-31 2023-10-05 Wing Aviation Llc Method for Semantic Localization of an Unmanned Aerial Vehicle
CN115900639B (en) * 2023-03-08 2023-05-30 深圳市科思科技股份有限公司 Course angle correction method and server applied to cradle head camera on unmanned aerial vehicle
CN117784800A (en) * 2024-02-27 2024-03-29 锐驰激光(深圳)有限公司 Obstacle avoidance method, device, equipment and storage medium based on adaptable view angle

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2813189C2 (en) * 1978-03-25 1984-03-08 Messerschmitt-Bölkow-Blohm GmbH, 8000 München Procedure for precise flight guidance and navigation
FR2657160B1 (en) 1990-01-12 1992-05-07 Aerospatiale ON-BOARD SYSTEM FOR DETERMINING THE POSITION OF AN AIR VEHICLE AND ITS APPLICATIONS.
US7191056B2 (en) 2005-01-04 2007-03-13 The Boeing Company Precision landmark-aided navigation
US8666661B2 (en) 2006-03-31 2014-03-04 The Boeing Company Video navigation
US7944547B2 (en) * 2006-05-20 2011-05-17 Zheng Wang Method and system of generating 3D images with airborne oblique/vertical imagery, GPS/IMU data, and LIDAR elevation data
US8265817B2 (en) 2008-07-10 2012-09-11 Lockheed Martin Corporation Inertial measurement with an imaging sensor and a digitized map
US8600194B2 (en) * 2011-05-17 2013-12-03 Apple Inc. Positional sensor-assisted image registration for panoramic photography
CN102353377B (en) * 2011-07-12 2014-01-22 北京航空航天大学 High altitude long endurance unmanned aerial vehicle integrated navigation system and navigating and positioning method thereof
JP5440567B2 (en) * 2011-07-27 2014-03-12 株式会社デンソー Map difference data distribution system, map difference data distribution device, and map difference data distribution method
FR3000813B1 (en) * 2013-01-04 2016-04-15 Parrot ROTARY SAILING DRONE COMPRISING MEANS FOR AUTONOMOUS POSITION DETERMINATION IN AN ABSOLUTE FLOOR - RELATED MARK.
US9075415B2 (en) * 2013-03-11 2015-07-07 Airphrame, Inc. Unmanned aerial vehicle and methods for controlling same
US20140312165A1 (en) * 2013-03-15 2014-10-23 Armen Mkrtchyan Methods, apparatus and systems for aerial assessment of ground surfaces
SG2013042890A (en) * 2013-06-03 2015-01-29 Ctrlworks Pte Ltd Method and apparatus for offboard navigation of a robotic device
KR101575020B1 (en) * 2014-03-24 2015-12-07 주식회사 디젠 Method for compensation of data latency in navigation system
US10301018B2 (en) * 2014-10-17 2019-05-28 Tyco Fire & Security Gmbh Fixed drone visualization in security systems
KR101624185B1 (en) * 2014-12-09 2016-05-25 현대자동차주식회사 Terminal, Vehicle communicating with the terminal and method for controlling the same
US9387928B1 (en) 2014-12-18 2016-07-12 Amazon Technologies, Inc. Multi-use UAV docking station systems and methods
CN104794435B (en) * 2015-04-03 2017-12-29 中国科学院自动化研究所 A kind of unmanned plane of view-based access control model moving target detecting method over the ground
CN106325305B (en) * 2015-06-29 2020-03-20 优利科技有限公司 Camera for ground positioning or navigation, aircraft and navigation method and system thereof
US9852645B2 (en) * 2015-08-17 2017-12-26 The Boeing Company Global positioning system (“GPS”) independent navigation system for a self-guided aerial vehicle utilizing multiple optical sensors
US9989965B2 (en) * 2015-08-20 2018-06-05 Motionloft, Inc. Object detection and analysis via unmanned aerial vehicle
US10053218B2 (en) * 2016-03-31 2018-08-21 General Electric Company System and method for positioning an unmanned aerial vehicle
CN105867361A (en) * 2016-04-18 2016-08-17 深圳市道通智能航空技术有限公司 Method and device for flight direction control and unmanned aerial vehicle thereof
US10054445B2 (en) * 2016-05-16 2018-08-21 Northrop Grumman Systems Corporation Vision-aided aerial navigation
CN105955288B (en) * 2016-07-15 2021-04-09 北京远度互联科技有限公司 Aircraft positioning and control method and system
CN106355197A (en) * 2016-08-24 2017-01-25 广东宝乐机器人股份有限公司 Navigation image matching filtering method based on K-means clustering algorithm
CN106227235A (en) * 2016-09-05 2016-12-14 重庆零度智控智能科技有限公司 Flying vehicles control method, device and user terminal
CN106412840A (en) * 2016-10-21 2017-02-15 北京佰才邦技术有限公司 Information transmission method of unmanned device, and base station
CN106646485A (en) * 2016-12-14 2017-05-10 天津文康科技有限公司 Unmanned aerial vehicle positioning system with integrated electromechanical distance measurement
CN106774402A (en) * 2016-12-28 2017-05-31 湖南省道通科技有限公司 The method and device positioned to unmanned plane
US10465840B2 (en) * 2017-03-22 2019-11-05 Gopro, Inc. Calibration for image stabilization mechanism
US10379545B2 (en) * 2017-07-03 2019-08-13 Skydio, Inc. Detecting optical discrepancies in captured images

Also Published As

Publication number Publication date
US20190197292A1 (en) 2019-06-27
AU2018388887A1 (en) 2020-06-18
AU2021202509A1 (en) 2021-05-20
FI3729227T3 (en) 2023-01-13
AU2021202509B2 (en) 2022-09-29
AU2018388887B2 (en) 2021-03-25
WO2019125921A1 (en) 2019-06-27
US10685229B2 (en) 2020-06-16
EP3729227B1 (en) 2022-11-30
EP3729227A1 (en) 2020-10-28
CN111492326B (en) 2024-04-19
CN111492326A (en) 2020-08-04

Similar Documents

Publication Publication Date Title
SG11202005399WA (en) Image based localization for unmanned aerial vehicles, and associated systems and methods
IL267984A (en) System and method for intercepting unmanned aerial vehicles
GB2574704B (en) Apparatuses and methods for gesture-controlled unmanned aerial vehicles
GB2560108B (en) Unmanned aerial vehicles
IL241200A0 (en) System and method for self-geoposition an unmanned aerial vehicle
IL242672A0 (en) Capure devices for unmanned aerial vehicles, including track-borne capture lines, and associated systems and methods
EP3157811A4 (en) Unmanned aerial vehicle base station system and method
EP3125064A4 (en) Cargo transport system and method based on unmanned aerial vehicle
GB201812342D0 (en) Unmanned aerial vehicles
GB2550489B (en) An unmanned aerial vehicle
SG11202009731TA (en) Localization device and localization method for unmanned aerial vehicle
SG11202009537YA (en) Unmanned aerial vehicle delivery system
GB201812365D0 (en) Unmanned aerial vehicles
EP3432111A4 (en) Control apparatus for unmanned aerial vehicle, and unmanned aerial vehicle
GB2575709B (en) Autonomous aerial vehicle system
GB201819872D0 (en) Unmanned aerial vehicles
GB201802091D0 (en) Unmanned aerial vehicles
SG10202104380VA (en) Unmanned aerial vehicle, and method for using same
EP3448756A4 (en) System and method for an unmanned aerial vehicle
GB201903613D0 (en) Unmanned aerial vehicles
AU2015900697A0 (en) Local Positioning System for An Unmanned Aerial Vehicle
GB201521619D0 (en) Unmanned aerial vehicle system