CN101701828B - Blind autonomous navigation method based on stereoscopic vision and information fusion - Google Patents
Blind autonomous navigation method based on stereoscopic vision and information fusion Download PDFInfo
- Publication number
- CN101701828B CN101701828B CN200910234985A CN200910234985A CN101701828B CN 101701828 B CN101701828 B CN 101701828B CN 200910234985 A CN200910234985 A CN 200910234985A CN 200910234985 A CN200910234985 A CN 200910234985A CN 101701828 B CN101701828 B CN 101701828B
- Authority
- CN
- China
- Prior art keywords
- image
- output
- obtains
- information fusion
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 title claims abstract description 10
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 238000003709 image segmentation Methods 0.000 claims abstract description 11
- 238000000605 extraction Methods 0.000 claims abstract description 8
- 230000004888 barrier function Effects 0.000 claims description 23
- 230000008878 coupling Effects 0.000 claims description 13
- 238000010168 coupling process Methods 0.000 claims description 13
- 238000005859 coupling reaction Methods 0.000 claims description 13
- 239000004744 fabric Substances 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 3
- 239000007787 solid Substances 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 abstract description 3
- 238000007781 pre-processing Methods 0.000 abstract 2
- 230000008901 benefit Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000000295 complement effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Landscapes
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Processing Or Creating Images (AREA)
- Position Fixing By Use Of Radio Waves (AREA)
- Traffic Control Systems (AREA)
Abstract
本发明涉及导航系统的技术领域,尤其是一种基于立体视觉和信息融合的盲人自主导航方法。左边图像与右边图像输出连接图像预处理,图像预处理输出连接图像分割,图像分割连接特征提取,特征提取输出连接立体匹配,立体匹配输出连接获取视差图,获取视差图输出连接获取深度图像和目标探测与标识,获取深度图像输出连接目标探测与标识,目标探测与标识输出连接目标尺寸、距离和方向参与计算,目标尺寸、距离和方向参与计算输出连接多传感器信息融合,多传感器信息融合输出连接语音输出障碍位置、大小、距离及方向等信息,超声波测距、电子罗盘测向和GPS定位输出连接多传感器信息融合。本发明的算法对于提高盲人的自主性和独立行走能力有很大的实用价值。
The invention relates to the technical field of navigation systems, in particular to an autonomous navigation method for blind people based on stereo vision and information fusion. The output of the left image and the right image is connected to image preprocessing, the output of image preprocessing is connected to image segmentation, the output of image segmentation is connected to feature extraction, the output of feature extraction is connected to stereo matching, the output of stereo matching is connected to obtain disparity map, and the output connection of obtaining disparity map is connected to obtain depth image and target Detection and identification, acquisition of depth image output connection target detection and identification, target detection and identification output connection target size, distance and direction participate in calculation, target size, distance and direction participate in calculation output connection multi-sensor information fusion, multi-sensor information fusion output connection Voice output obstacle position, size, distance and direction and other information, ultrasonic ranging, electronic compass direction finding and GPS positioning output connection multi-sensor information fusion. The algorithm of the invention has great practical value for improving the autonomy and independent walking ability of blind people.
Description
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200910234985A CN101701828B (en) | 2009-11-23 | 2009-11-23 | Blind autonomous navigation method based on stereoscopic vision and information fusion |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200910234985A CN101701828B (en) | 2009-11-23 | 2009-11-23 | Blind autonomous navigation method based on stereoscopic vision and information fusion |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101701828A CN101701828A (en) | 2010-05-05 |
CN101701828B true CN101701828B (en) | 2012-10-03 |
Family
ID=42156748
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200910234985A Expired - Fee Related CN101701828B (en) | 2009-11-23 | 2009-11-23 | Blind autonomous navigation method based on stereoscopic vision and information fusion |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101701828B (en) |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201219752A (en) * | 2010-11-08 | 2012-05-16 | Ind Tech Res Inst | Automatic navigation method and automatic navigation system |
US9098908B2 (en) | 2011-10-21 | 2015-08-04 | Microsoft Technology Licensing, Llc | Generating a depth map |
CN103284866A (en) * | 2012-02-24 | 2013-09-11 | 鸿富锦精密工业(深圳)有限公司 | Walking auxiliary system and walking auxiliary method |
DE102012209316A1 (en) * | 2012-06-01 | 2013-12-05 | Robert Bosch Gmbh | Method and device for processing sensor data of a stereo sensor system |
CN103971356B (en) * | 2013-02-04 | 2017-09-08 | 腾讯科技(深圳)有限公司 | Street view image Target Segmentation method and device based on parallax information |
CN103750986A (en) * | 2014-01-24 | 2014-04-30 | 成都万先自动化科技有限责任公司 | Blind-guide suit |
US10028102B2 (en) * | 2014-12-26 | 2018-07-17 | Here Global B.V. | Localization of a device using multilateration |
JP6899369B2 (en) * | 2015-08-03 | 2021-07-07 | トムトム グローバル コンテント ベスローテン フエンノートシャップ | Methods and systems for generating and using localization reference data |
CN105342816A (en) * | 2015-11-24 | 2016-02-24 | 上海斐讯数据通信技术有限公司 | Real-time obstacle avoidance system for guiding blind |
CN106909141A (en) * | 2015-12-23 | 2017-06-30 | 北京机电工程研究所 | Obstacle detection positioner and obstacle avoidance system |
CN105698763A (en) * | 2016-01-22 | 2016-06-22 | 吉林大学 | Device and method for detecting barriers through stereoscopic vision |
CN105997448B (en) * | 2016-04-30 | 2019-04-26 | 中国海洋大学 | Frequency Domain Projection Ultrasonic Echo Location Guide for the Blind |
CN106197452A (en) * | 2016-07-21 | 2016-12-07 | 触景无限科技(北京)有限公司 | A kind of visual pattern processing equipment and system |
CN106197429A (en) * | 2016-07-21 | 2016-12-07 | 触景无限科技(北京)有限公司 | A kind of Multi-information acquisition location equipment and system |
CN106289290A (en) * | 2016-07-21 | 2017-01-04 | 触景无限科技(北京)有限公司 | A kind of path guiding system and method |
CN106289232B (en) * | 2016-07-24 | 2019-06-21 | 广东大仓机器人科技有限公司 | A robot obstacle avoidance method based on depth sensor |
CN106408613A (en) * | 2016-09-18 | 2017-02-15 | 合肥视尔信息科技有限公司 | Stereoscopic vision building method suitable for virtual lawsuit advisor |
JP7216672B2 (en) * | 2017-07-12 | 2023-02-01 | ジェンテックス コーポレイション | Visual, Depth, and Microvibration Data Extraction Using an Integrated Imager |
CN107610152B (en) * | 2017-08-31 | 2020-02-28 | 杭州视氪科技有限公司 | Passage detection method for avoiding water surface and obstacles |
CN107909009B (en) * | 2017-10-27 | 2021-09-17 | 北京中科慧眼科技有限公司 | Obstacle detection method and device based on road surface learning |
CN108012325B (en) * | 2017-10-30 | 2021-01-19 | 上海神添实业有限公司 | Navigation positioning method based on UWB and binocular vision |
CN107802468B (en) * | 2017-11-14 | 2020-01-10 | 石化盈科信息技术有限责任公司 | Blind guiding method and blind guiding system |
CN108627816A (en) * | 2018-02-28 | 2018-10-09 | 沈阳上博智像科技有限公司 | Image distance measuring method, device, storage medium and electronic equipment |
CN109931946A (en) * | 2019-04-10 | 2019-06-25 | 福州大学 | Visual ranging navigation method for blind people based on Android smartphone |
CN110194085B (en) * | 2019-05-12 | 2019-11-19 | 猫头鹰安防科技有限公司 | The electron assistant platform of view-based access control model detection |
CN110346004B (en) * | 2019-08-16 | 2020-08-21 | 杭州山科智能科技股份有限公司 | Flow measurement data fusion method of dual-channel ultrasonic time difference method |
CN110470307A (en) * | 2019-08-28 | 2019-11-19 | 中国科学院长春光学精密机械与物理研究所 | A kind of visually impaired patient navigation system and method |
CN113108780A (en) * | 2021-03-30 | 2021-07-13 | 沈奥 | Unmanned ship autonomous navigation method based on visual inertial navigation SLAM algorithm |
CN113420704A (en) * | 2021-06-18 | 2021-09-21 | 北京盈迪曼德科技有限公司 | Object identification method and device based on visual sensor and robot |
CN116549218B (en) * | 2023-05-12 | 2024-12-03 | 江西恒必达实业有限公司 | Intelligent blind guiding glasses based on obstacle monitoring and reminding |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5107467A (en) * | 1990-04-13 | 1992-04-21 | Jorson Enterprises, Inc. | Echo location system for vision-impaired persons |
US6198395B1 (en) * | 1998-02-09 | 2001-03-06 | Gary E. Sussman | Sensor for sight impaired individuals |
CN2500297Y (en) * | 2001-09-13 | 2002-07-17 | 潘爱武 | Ultrasonic echo navigator for blind person |
CN101368828A (en) * | 2008-10-15 | 2009-02-18 | 同济大学 | Navigation method and system for the blind based on computer vision |
CN101483806A (en) * | 2009-02-24 | 2009-07-15 | 南京师范大学 | Outdoor blind guidance service system and method oriented to blind disturbance people |
-
2009
- 2009-11-23 CN CN200910234985A patent/CN101701828B/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5107467A (en) * | 1990-04-13 | 1992-04-21 | Jorson Enterprises, Inc. | Echo location system for vision-impaired persons |
US6198395B1 (en) * | 1998-02-09 | 2001-03-06 | Gary E. Sussman | Sensor for sight impaired individuals |
CN2500297Y (en) * | 2001-09-13 | 2002-07-17 | 潘爱武 | Ultrasonic echo navigator for blind person |
CN101368828A (en) * | 2008-10-15 | 2009-02-18 | 同济大学 | Navigation method and system for the blind based on computer vision |
CN101483806A (en) * | 2009-02-24 | 2009-07-15 | 南京师范大学 | Outdoor blind guidance service system and method oriented to blind disturbance people |
Non-Patent Citations (2)
Title |
---|
王臣豪等.基于Blob的车辆识别及其跟踪算法研究.《第十二届全国信号处理学术年会(CCSP-2005)论文集》.2005,全文. * |
黄穗等.基于边缘矩阵的链编码追踪算法.《石河子大学学报(自然科学版)》.2005,第23卷(第5期),全文. * |
Also Published As
Publication number | Publication date |
---|---|
CN101701828A (en) | 2010-05-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101701828B (en) | Blind autonomous navigation method based on stereoscopic vision and information fusion | |
CN112101128B (en) | A perception planning method for unmanned formula racing car based on multi-sensor information fusion | |
CN108196535B (en) | Automatic driving system based on reinforcement learning and multi-sensor fusion | |
CN105946853B (en) | The system and method for long range automatic parking based on Multi-sensor Fusion | |
Schreiber et al. | Laneloc: Lane marking based localization using highly accurate maps | |
EP3647734A1 (en) | Automatic generation of dimensionally reduced maps and spatiotemporal localization for navigation of a vehicle | |
WO2018133851A1 (en) | Point cloud data processing method and apparatus, and computer storage medium | |
EP2574958B1 (en) | Road-terrain detection method and system for driver assistance systems | |
CN113903011B (en) | Semantic map construction and positioning method suitable for indoor parking lot | |
CN103760569B (en) | A kind of drivable region detection method based on laser radar | |
CN111837014A (en) | System and method for anonymizing navigation information | |
CN107389084B (en) | Driving path planning method and storage medium | |
CN107392103A (en) | The detection method and device of road surface lane line, electronic equipment | |
CN110390831A (en) | route determination device | |
CN107657825A (en) | Park method and device | |
CN114119896B (en) | Driving path planning method | |
US20220266824A1 (en) | Road information generation apparatus | |
CN116147613A (en) | Method and system for generating and locating environmental models using cross sensor feature point references | |
US12025714B2 (en) | Method and apparatus for determining location by correcting global navigation satellite system based location and electronic device thereof | |
CN116543043A (en) | Method and processor device for locating a motor vehicle in an environment during driving, and correspondingly equipped motor vehicle | |
CN115112130A (en) | Vehicle position estimation device | |
CN118111442A (en) | Navigation system based on virtual three-dimensional live-action indoor and outdoor and vehicle searching guidance | |
US20230314162A1 (en) | Map generation apparatus | |
JP4957021B2 (en) | VEHICLE MAP DATA CREATION DEVICE AND VEHICLE MAP DATA UPDATE DEVICE | |
CN114944073A (en) | Map generation device and vehicle control device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
ASS | Succession or assignment of patent right |
Owner name: CHANGZHOU INSTITUTE OF SUPERMEDIA AND SENSING TECH Free format text: FORMER OWNER: CHANGZHOU DAQI INFORMATION TECHNOLOGY CO., LTD. Effective date: 20111213 |
|
C41 | Transfer of patent application or patent right or utility model | ||
C53 | Correction of patent for invention or patent application | ||
CB03 | Change of inventor or designer information |
Inventor after: Zhou Dongxiang Inventor after: Liu Yunhui Inventor after: Liu Shun Inventor after: Yang Yanguang Inventor after: Fan Caizhi Inventor after: Cai Xuanping Inventor before: Liu Yunhui Inventor before: Yang Yanguang Inventor before: Liu Shun Inventor before: Fan Caizhi Inventor before: Zhou Dongxiang Inventor before: Cai Xuanping |
|
COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: LIU YUNHUI YANG YANGUANG LIU SHUN FAN CAIZHI ZHOU DONGXIANG CAI XUANPING TO: ZHOU DONGXIANG LIU YUNHUI LIU SHUN YANG YANGUANG FAN CAIZHI CAI XUANPING Free format text: CORRECT: ADDRESS; FROM: 213011 CHANGZHOU, JIANGSU PROVINCE TO: 213000 CHANGZHOU, JIANGSU PROVINCE |
|
TA01 | Transfer of patent application right |
Effective date of registration: 20111213 Address after: 213000 Jiangsu Province, the Clock Tower District, ERON Road, No. 213 High-tech Venture Center, room 1008 Applicant after: Changzhou Hyper Medium and Sensing Technology Institute Co., Ltd. Address before: 213011 1008, hi tech Innovation Service Center, 213 ERON Road, bell tower area, Jiangsu, Changzhou Applicant before: Changzhou Daqi Information Technology Co., Ltd. |
|
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
ASS | Succession or assignment of patent right |
Owner name: DEFENSIVE SCIENTIFIC AND TECHNOLOGICAL UNIV., PLA Effective date: 20130205 |
|
C41 | Transfer of patent application or patent right or utility model | ||
TR01 | Transfer of patent right |
Effective date of registration: 20130205 Address after: 213000 Jiangsu Province, the Clock Tower District, ERON Road, No. 213 High-tech Venture Center, room 1008 Patentee after: Changzhou Hyper Medium and Sensing Technology Institute Co., Ltd. Patentee after: National University of Defense Technology of People's Liberation Army of China Address before: 213000 Jiangsu Province, the Clock Tower District, ERON Road, No. 213 High-tech Venture Center, room 1008 Patentee before: Changzhou Hyper Medium and Sensing Technology Institute Co., Ltd. |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121003 Termination date: 20181123 |