WO2015083183A1 - Hand wearable haptic feedback based navigation device - Google Patents
Hand wearable haptic feedback based navigation device Download PDFInfo
- Publication number
- WO2015083183A1 WO2015083183A1 PCT/IN2014/000742 IN2014000742W WO2015083183A1 WO 2015083183 A1 WO2015083183 A1 WO 2015083183A1 IN 2014000742 W IN2014000742 W IN 2014000742W WO 2015083183 A1 WO2015083183 A1 WO 2015083183A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- haptic feedback
- hand
- distance
- navigation device
- based navigation
- Prior art date
Links
- 238000005259 measurement Methods 0.000 claims abstract description 21
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 4
- 230000001174 ascending effect Effects 0.000 claims description 3
- 239000000463 material Substances 0.000 claims description 3
- 230000004297 night vision Effects 0.000 claims description 2
- 238000013507 mapping Methods 0.000 abstract description 2
- 210000003811 finger Anatomy 0.000 description 20
- 238000002604 ultrasonography Methods 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 6
- 239000000523 sample Substances 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 210000003813 thumb Anatomy 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 210000003128 head Anatomy 0.000 description 4
- 230000001771 impaired effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 210000000887 face Anatomy 0.000 description 3
- 238000002955 isolation Methods 0.000 description 3
- 239000002184 metal Substances 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000003137 locomotive effect Effects 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000011664 nicotinic acid Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3652—Guidance using non-audiovisual output, e.g. tactile, haptic or electric stimuli
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H3/00—Appliances for aiding patients or disabled persons to walk about
- A61H3/06—Walking aids for blind persons
- A61H3/061—Walking aids for blind persons with electronic detecting or guiding means
- A61H2003/063—Walking aids for blind persons with electronic detecting or guiding means with tactile perception
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/1635—Hand or arm, e.g. handle
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/165—Wearable interfaces
Definitions
- the present invention relates to the field of guiding and navigation systems and devices. More specifically, it relates to a hand wearable haptic feedback based navigation device.
- the device can be used to assist blind people while walking, to access the obstacles and their distances. It can also be used by soldiers to access their enemy in dark night. It can, in fact, be used for applications where a normal vision with eyes is not possible.
- a navigation system is a system that aids in navigation. Navigation systems may be entirely on board a vehicle or vessel, or they may be located elsewhere and communicate via radio or other signals with a vehicle or vessel, or they may use a combination of these methods.
- Navigation systems may be capable of:
- Containing maps which may be displayed in human readable format via text or in a graphical format.
- ⁇ providing suggested directions to a human in charge of a vehicle or vessel via text or speech
- Global Positioning System a group of satellites and computers that can provide information on any person, vessel, or vehicle's location via a GPS receiver
- GPS navigation device a device that can receive GPS signals for the purpose of determining the device's location and possibly to suggest or give directions
- Surgical navigation system a system which determines the position of surgical instruments in relation to patient images such as CT or MRI scans.
- Inertial guidance system a system which continuously determines the position, orientation, and velocity (direction and speed of movement) of a moving object without the need for external reference
- Robotic mapping the methods and equipment by which an autonomous robot is be able to construct (or use) a map or floor plan and to localize itself within it
- Haptic technology is a tactile feedback technology which takes advantage of the sense of touch by applying forces, vibrations, or motions to the user. This mechanical stimulation can be used to assist in the creation of virtual objects in a computer simulation, to control such virtual objects, and to enhance the remote control of machines and devices (telerobotics).
- Applications of Haptic technology • Tactile electronic displays
- a tactile electronic display is a kind of display device that presents information in tactile form.
- the two most popular kinds of tactile electronic displays are various refreshable braille displays and the Optacon.
- a refreshable braille display or braille terminal is an electro-mechanical device for displaying braille characters, usually by means of round-tipped pins raised through holes in a flat surface.
- Blind computer users who cannot use a normal computer monitor, use it to read text output. Speech synthesizers are also commonly used for the same task, and a blind user may switch between the two systems or use both at the same time depending on circumstances.
- the Optacon (OPtical to TActile CONverter) is an electromechanical device that enables blind people to read printed material that has not been transcribed into Braille.
- Teleoperators are remote controlled robotic tools—when contact forces are reproduced to the operator, it is called haptic teleoperation.
- haptic teleoperation When such devices are simulated using a computer (as they are in operator training devices) it is useful to provide the force feedback that would be felt in actual operations. Since the objects being manipulated do not exist in a physical sense, the forces are generated using haptic (force generating) operator controls. Data representing touch sensations may be saved or played back using such haptic technologies.
- Haptic simulators are used in medical simulators and flight simulators for pilot training.
- haptic feedback There are many other applications of haptic feedback such as their use in video games, personal computers, mobile devices, medical field, robotics and art design.
- the inventor has designed and developed a hand wearable haptic feedback based navigation device which overcomes the above limitations of existing devices.
- the design and concept makes the device utter reliable, ergonomic, simple and reasonable.
- the device senses the 'distance' and 'direction' of the obstacles in 0-180 degree field of view and 4-6 directions in all. This information is communicated via Haptic feedback vibration motors on the surface of the hand and embedded in the glove.
- the wearable device the wearable device.
- the present invention uses removable and detachable sensors along with arduino controller .
- No camera is used as input device.
- the invention in the referred patent application relates to a tactile device comprising a plurality of actuators for producing navigation instructions.
- the tactile device is formed by an article of clothing wearable by a user.
- the tactile device is formed in such a way that, when being worn by a user, the plurality of actuators are positioned in a substantially closed path, surrounding part of a body of the user.
- the present invention uses removable and detachable sensors along with arduino controller.
- the circuit and software are simple and realistic as compared to the above application.
- the invention in the referred patent application discloses an accompanying robot system for assisting a visually impaired person in walking.
- the accompanying robot system comprises a vibrational touch waistband arranged on the waist of the visually impaired person, and four tracked robots positioned on the front, back, left and right of the visually impaired person; the four tracked robots and the vibrational touch waistband form a wireless sensor network through an Ad Hoc Network; each tracked robot comprises a body and a control module; the control module comprises an ultrasonic distance measurement sensor, a laser distance measurement sensor, a motion control module, a wireless communication module, a central processing module and a power supply; the ultrasonic distance measurement sensor and the laser distance measurement sensor are arranged at the back and front ends of the body, and outputs of the ultrasonic distance measurement sensor and the laser distance measurement sensor are connected with the central processing module; the output of the central processing module is connected with the motion control module; the output of the central processing module is bi directionally connected with the wireless communication module.
- the present device is low cost, fulfills the objective of being affordable and industrially applicable.
- sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
- US20130039152 The device of the patent application has a fixed and defined plane for mounting two sensors.
- sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
- the devices of the patent application is based on multiple sensors connected with the blind walking aid especially a hat which has embedded circuit device comprising of a base plate power supply module, an ultrasonic module main control module , voice outputting module to transmit voice information to the user.
- sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
- the device uses haptic feedback system and no voice outputting module is required.
- the device of the present application uses haptic feedback system and no voice outputting module is required. It uses sensors and no audio frequencies are received or transmitted.
- the device of the present application uses haptic feedback system and no voice outputting module is required. It uses sensors and no audio frequencies are received or transmitted.
- the utility models referred here provide intelligent blind aid system WO2006074993 and an intelligent blind aid either in the form of cane or goggles or (A2) waist bands. Most of these provide intelligent blind aid cane; a first
- US6671226 (Bl) ultrasonic range acquisition module is arranged at the middle of the US6198395 (Bl) cane; the ultrasonic transmitting head of the first ultrasonic range WO9740403 (Al) acquisition module faces to the front for detecting obstacles ahead; a WO9600401 (Al) second ultrasonic range acquisition module is arranged at the upper US4712003 (A) part of the cane; the ultrasonic transmitting head of the second US4280204 (A) ultrasonic range acquisition module faces upwards to the front for EP0008455 (Bl) detecting obstacles in a front upper place; an infrared range acquisition module is arranged at the lower part of the cane at the vertical distance of 2-30 cm to the ground; and the infrared transmitting head faces to the front for detecting low obstacles on the ground.
- the device of the present application uses haptic feedback system. It neither is a cane nor uses infrared frequencies.
- WO9740403 (Al) The device of the patent application is a personal object detector using continuous transmission frequency modulation and an audio output device.
- the device of the present application uses haptic feedback system.
- sensors are detachable and attachable with the help of spring fit, clip fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
- WO2007084122 The devices of the patent applications are used for determining the (A3) and direction of an acoustic highlight, comprising receiving US2006098533 backscattered, analog, ultrasonic sound-pressure pulses at the (Al) microphones of said acoustic vector probe; converting said backscattered analog ultrasonic sound-pressure pulses simultaneously into digital form and inputting these signals into said digital signal processor; lowering the frequency of said backscattered ultrasonic sound-pressure pulses to the audible range by heterodyning thereby highlighting the source of backscattered ultrasonic pulses.
- the device of the present application uses haptic feedback system rather than audio output.
- WO2008086178 acoustic source and a pair of miniature microphone arrays with (Al) and frequency-dependent beam patterns designed to mimic the properties US6469956 (Bl) of the human ear.
- Each microphone is preferably mounted near a respective ear of the user.
- the acoustic source and microphone arrays are mounted on the user's head so that the system will always be aligned therewith-as an example, they may be mounted near the user's ears on conventional eyeglass frames or a similar mounting device. Then each ear of the human receives measurement information.
- the device of the present application uses haptic feedback system rather than audio output.
- the utility model relates to a glove which uses ultrasound to achieve obstacle prompt for blind, the structure comprises a first isolation sheet metal , an ultrasound emission probe , an ultrasound receiving transducer and a vibration motor , wherein the first isolation sheet metal is sleeved on a fourth and a fifth finger portions of the glove , the ultrasound emission probe, the ultrasound receiving transducer and the vibration motor are arranged on the first isolation sheet metal, one end of a connecting line is connected with the ultrasound emission probe, the ultrasound receiving transducer and the vibration motor, and the other end is connected with a circuit board which is equipped with a power interface.
- the device is capable of probing the distance of an obstacle on a road and transforms the distance messages of the obstacle into vibration to prompt the bind. He is capable of judging the distance of the obstacle in accordance with change in strength of the probe.
- the present device has sensors that are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle and any direction.
- the main object of the present invention is to disclose a hand wearable haptic feedback based navigation device which has the flexibility of attachment and detachment of the navigation sensors.
- Another object of the invention is to disclose a hand wearable haptic feedback based navigation device which has the flexibility of sensing the distance of the obstacle in multiple directions covering a maximum of 180 degree field of view in the direction in which the hand is pointing.
- Yet another object of the present invention is to disclose a hand wearable haptic feedback based navigation device which constantly transmits the distance of an obstacle to an external high performance device via wired or wireless communication after combining it with a 10 degrees of freedom Inertial measurement sensor that senses the special orientation of the hand with respect to the distance measured. Hence producing a 3D image of the objects/area in front in the form of a 3D graph.
- the present invention consists of distance sensors mounted on the gloves at the position of the finger tips. These sensors sense the distance of any hindrance, obstacles etc. from the finger's tip and transmit them to the microcontroller which is embedded in the glove itself. The microcontroller accordingly drives the vibration motors embedded in the glove. Since there are 5 fingers; all in different direction which when opened in full stretch make an angle of roughly 180 degrees, every finger tells the distance of obstacle in its direction.
- FIGURE 1 Block diagram of present invention
- Distance sensor unit it may be ultrasonic based, infrared based, laser based or any distance sensing device. For 5 fingers there are five such sensors. 2. 10 degrees of freedom Inertial measurement sensor
- High performance device IOS, android based mobile platforms, computers, laptops or any other high performance device.
- Logic circuit for Distance 0-33% of the maximum distance or any set category.
- Logic circuit for Distance 33-66 of the maximum distance or any set category.
- Vibrator 2 powered ON on that particular finger.
- FIGURE 2 Present embodiment as a glove
- Vibrators or any other haptic feedback generating device Vibrators or any other haptic feedback generating device.
- Battery pack may or may not be disposed on hand though
- FIGURE 3 Hand pointing in two axis at a time
- FIGURE 4 Hand pointing in three axis at a time
- FIGURE 5 Hand pointing in one axis 180 degrees
- FIGURE 6 Hand pointing in downward direction DETAILED DESCRIPTION OF THE INVENTION:
- Auditory (hearing) system generally being able to process only one sound at a time makes it difficult for the user to understand any auditory signal that informs the presence of more than one obstacle and it's direction at the very same time.
- headphones set a barter agreement somewhere between sight and hearing as the user is neither able to hear clearly not able to see (if he is blind).
- Speaker based audio feedback is evidently not practical in already noisy places and may prove to be disturbing in places where silence needs to be maintained.
- the present invention uses the other alternative of using touch sense to detect distance.
- the inventor has designed and developed special pair of gloves which is provided with attachable and detachable distance sensors (101) along with a microcontroller (104) embedded in the glove itself.
- the present invention is powered by a battery pack (102) which may or may not be disposed on hand though, a bug and error detection unit (103) for detecting any electronic, mechanical or software malfunction.
- a 10 degrees of freedom Inertial measurement sensor unit (105) along with wireless or wired transmission unit.
- the mechanism used for attachment and detachment can be any mechanism like stretchable wire loop fitted with sensor and made of elastic or any other suitable material or clip fit mechanism or any other mechanism that can let the distance sensing unit to be fixed on the finger and may or may also allow the user to rotate them about the fixed point.
- the inventor has shown already stretched and fitted sensors (101) at the position of the finger tips. These sensors sense the distance of any hindrance, obstacles etc. from the fingers tip and signals the microcontroller (104). Since there are 5 fingers all in different direction which when opened in full stretch, cover an angle of approximately 180 degrees, every finger is capable of sensing the distance of obstacle in its direction thereby covering multiple directions. Since the direction of the sensors can be fully controlled by the user by pointing his finger to any direction, there is no limitation of sensing any particular direction.
- Every finger is equipped with distance sensors (101) and three vibrators (100 of fig 2 or 11, 13, 15 of fig 1) for providing haptic feedback to the user; the user may use more or less vibrators on the finger depending on his sensing capability.
- every finger has a dedicated on board microcontroller (104) so that in case of failure of one, the rest can work.
- the vibrators (100 of fig 2 or 11, 13, 15 of fig 1) are calibrated with respect to the distance of an obstacle from the user with the help of logic circuits (10, 12, 14 of Fig 1) in the MCU (104).
- logic circuits (10, 12, 14 of Fig 1) in the MCU (104).
- logic circuit (10) gives output which powers up first vibrator (11 of Fig 1) and it starts vibrating.
- logic circuit (12) gives output which powers up first vibrator (13 of Fig 1) and it starts vibrating.
- logic circuit (14) gives output which powers up first vibrator (15 of Fig 1) and it starts vibrating. 3.
- input from 10 degrees of freedom Inertial measurement sensor unit (105 of Fig 2 or 2 of fig 1) is also fed to the onboard microcontroller (104 of Fig 2). This performs the usual task with the vibrators but along with it also sends the data of distance sensed by all the distance sensors and the direction and position of the hand sensed via 10 degrees of freedom Inertial measurement sensor (105 of Fig 2 or 2 of fig 1) to a wireless or wired signal transmitter ( 4 of fig 1) working as a high performance device.
- This device may be a mobile, laptop or any other high performance portable or non-portable.
- the high performance device ( 4 of fig 1) receives the 'direction and spacial orientation of hand' and the distance of the obstacle from the distance sensors and plots that in the form of a graph on 3D output device ( 6 of fig 1) .
- the hand now works like a bionic scanner. As the user moves the hand in random directions the graph gets plotted. Every direction has a coordinate on the 10 degrees of freedom Inertial measurement sensor therefore speed, randomness etc. does not affect the graph.
- This graph can be saved or plotted on a high performance machine by sending the data through wireless signal transmitter (7 of fig 1) to an external display, projector etc.
- More detailed view can be achieved by combining sensors such as infrared sensors, PIR sensors and night vision.
- the distance may be also be mapped via high performance laser sensors and the user may be able to map an entire locality from a suitable height with greatest accuracy.
- two sensors can be mounted , one each at the top and bottom of the hand to sense stairs (ascending/descending), pits and sudden irregularities in the path.
- These sensors mounted on the top and bottom work in a similar manner and share a single MCU.
- the vibrators (100) on the lower hand are calibrated in such a way so as to indicate an ascending stair, descending stair, sudden pit or a sudden elevation.
- the upper vibrators are calibrated in such a way so as to indicate a thin obstacle or a major big obstacle at the head level.
- the sensors may have on board micro controller and may be integrally strapped on two or more individual fingers.
- the microcontroller used is of PC which is an open source chip thereby making the device workable in any generic mode and customizable according to the user's demand.
- the device of present invention is less complex, easy to manufacture, is low cost and is user friendly.
- the unique concept of using a 10 degrees of freedom Inertial measurement sensor in combination with sensors and vibrators, converting the data received into graphs and maps, providing capability of transmitting the data to a remote location makes it a versatile device for navigation . None of the available prior art patents have provided solution of this kind, thus the invention is novel in itself.
- the first inventive step lies in haptic feedback which is not specific to the hand but to every finger. This renders obstacles 5 directions to be sensed at a time.
- the second inventive step is to incorporate a 10 degrees of freedom Inertial measurement sensor to sense the spacial orientation of the hand. This eventually makes it possible to 3D map the view in front just by random hand movements.
- the third inventive step involves making the sensors detachable. This ensures that while the user needs lower accuracies in distance measurement he can free up fingers for normal use.
- the final inventive step is the design. Firstly all the components are SMD and no moving parts are there such as servos etc. This manifests a robust design. Secondly the whole setup is wearable so the person need not carry it. Thirdly there is no tasking on the locomotive and auditory dexterity of the user as there is no audio feedback involved.
- the distance sensing device can be used successfully by blind as an aid while walking on road or on staircase.
- the same device can also be used by the soldiers in dark war field. They can simply wear this device and feel the vibration or view a 3D or 2D graph of what is in front.
- Another application is in the field of animal study where the researchers have to watch the movement of animals in a jungle during night.
- the present invention finds application in any field where distance sensing is required without use of normal eye sight.
- the device is low cost and can be manufactured at an industrial scale with great ease.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Theoretical Computer Science (AREA)
- Remote Sensing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Automation & Control Theory (AREA)
- Life Sciences & Earth Sciences (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Physical Education & Sports Medicine (AREA)
- Rehabilitation Therapy (AREA)
- Multimedia (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- User Interface Of Digital Computer (AREA)
- Rehabilitation Tools (AREA)
Abstract
The present invention is a hand wearable haptic feedback based navigation device for distance sensing which has the flexibility of attachment and detachment of the navigation sensors (101) and has the flexibility of sensing the distance of the obstacle in multiple directions covering maximum 180 degrees in the direction of pointing of the hand. The device measures the distance of obstacle using sensors (101) at the tip of a finger. The measurement is broken down into categories on the basis of distance. This category is eventually informed to the user via haptic feedback actuators (100) strategically located on the specific finger. The feedback is taken to three dimensions by mapping the hand's spacial orientations using Inertial measurement units (2).
Description
HAND WEARABLE HAPTIC FEEDBACK BASED NAVIGATION DEVICE
FIELD OF INVENTION
The present invention relates to the field of guiding and navigation systems and devices. More specifically, it relates to a hand wearable haptic feedback based navigation device. The device can be used to assist blind people while walking, to access the obstacles and their distances. It can also be used by soldiers to access their enemy in dark night. It can, in fact, be used for applications where a normal vision with eyes is not possible.
BACKGROUND OF THE INVENTION
ABOUT NAVIGATION SYSTEMS AND DEVICES:A navigation system is a system that aids in navigation. Navigation systems may be entirely on board a vehicle or vessel, or they may be located elsewhere and communicate via radio or other signals with a vehicle or vessel, or they may use a combination of these methods.
Navigation systems may be capable of:
• Containing maps which may be displayed in human readable format via text or in a graphical format.
determining a vehicle or vessel's location via sensors, maps, or information from external sources
· providing suggested directions to a human in charge of a vehicle or vessel via text or speech
providing directions directly to an autonomous vehicle such as a robotic probe or guided missile
• providing information on nearby vehicles or vessels, or other hazards or obstacles · providing information on traffic conditions and suggesting alternative directions
Types of navigation systems
• Automotive navigation system
• Marine navigation system
· Global Positioning System, a group of satellites and computers that can provide information on any person, vessel, or vehicle's location via a GPS receiver
• GPS navigation device, a device that can receive GPS signals for the purpose of determining the device's location and possibly to suggest or give directions
• Surgical navigation system, a system which determines the position of surgical instruments in relation to patient images such as CT or MRI scans.
• Inertial guidance system, a system which continuously determines the position, orientation, and velocity (direction and speed of movement) of a moving object without the need for external reference
• Robotic mapping, the methods and equipment by which an autonomous robot is be able to construct (or use) a map or floor plan and to localize itself within it
• Web navigation
• XNAV for Deep Space
ABOUT HAPTIC TECHNOLOGY:
Haptic technology is a tactile feedback technology which takes advantage of the sense of touch by applying forces, vibrations, or motions to the user. This mechanical stimulation can be used to assist in the creation of virtual objects in a computer simulation, to control such virtual objects, and to enhance the remote control of machines and devices (telerobotics). Applications of Haptic technology • Tactile electronic displays
A tactile electronic display is a kind of display device that presents information in tactile form. The two most popular kinds of tactile electronic displays are various refreshable braille displays and the Optacon.
A refreshable braille display or braille terminal is an electro-mechanical device for displaying braille characters, usually by means of round-tipped pins raised through holes in a
flat surface. Blind computer users, who cannot use a normal computer monitor, use it to read text output. Speech synthesizers are also commonly used for the same task, and a blind user may switch between the two systems or use both at the same time depending on circumstances.
The Optacon (OPtical to TActile CONverter) is an electromechanical device that enables blind people to read printed material that has not been transcribed into Braille.
• Tele operators and simulators
Teleoperators are remote controlled robotic tools— when contact forces are reproduced to the operator, it is called haptic teleoperation. When such devices are simulated using a computer (as they are in operator training devices) it is useful to provide the force feedback that would be felt in actual operations. Since the objects being manipulated do not exist in a physical sense, the forces are generated using haptic (force generating) operator controls. Data representing touch sensations may be saved or played back using such haptic technologies. Haptic simulators are used in medical simulators and flight simulators for pilot training.
There are many other applications of haptic feedback such as their use in video games, personal computers, mobile devices, medical field, robotics and art design.
(Ref: Wikipedia) Many navigation systems and devices have been designed and developed based on haptic feedback . They suffer from the following limitations.
LIMITATIONS OF EXISTING NAVIGATION SYSTEMS AND DEVICES:
1. High Cost- The available navigation systems are very expensive. 2. Less portability- The available devices once fitted, are difficult to remove hence making them less portable
3. Maintenance problems- The existing devices being technically complex, are difficult and expensive to manufacture to provide them to grass root people. At the same time, these are difficult to repair on breakdown.
4. Multi direction sensing not possible- No existing device provides a multi-directional realistic and relative data covering an angle upto 180 degree using distance sensors.
5. Lack of open source capability- Since the circuitry and designing of existing devices is very complex, none of them provides the capability to customize the same as per the requirement of a specific individual .
INNOVATIVE SOLUTION PROPOSED BY INVENTOR:
The inventor has designed and developed a hand wearable haptic feedback based navigation device which overcomes the above limitations of existing devices.
The design and concept makes the device utter reliable, ergonomic, simple and reasonable. The device senses the 'distance' and 'direction' of the obstacles in 0-180 degree field of view and 4-6 directions in all. This information is communicated via Haptic feedback vibration motors on the surface of the hand and embedded in the glove.
PRIOR ART AND ITS DRAWBACKS:
In comparison, the present invention uses removable and detachable sensors along with arduino controller . No camera is used as input device.
WO2007105937 Al The invention in the referred patent application relates to a tactile device comprising a plurality of actuators for producing navigation instructions. The tactile device is formed by an article of clothing wearable by a user. The tactile device is formed in such a way that, when being worn by a user, the plurality of actuators are positioned in a substantially closed path, surrounding part of a body of the user.
In comparison, the present invention uses removable and detachable sensors along with arduino controller. The circuit and software are simple and realistic as compared to the above application.
CN 102614068 A The invention in the referred patent application discloses an accompanying robot system for assisting a visually impaired person in walking. The accompanying robot system comprises a vibrational touch waistband arranged on the waist of the visually impaired person, and four tracked robots positioned on the front, back, left and right of the visually impaired person; the four tracked robots and the vibrational touch waistband form a wireless sensor network through an Ad Hoc Network; each tracked robot comprises a body and a control module; the control module comprises an ultrasonic distance measurement sensor, a laser distance measurement sensor, a motion control module, a wireless communication module, a central processing module and a power supply; the ultrasonic distance measurement sensor and the laser distance measurement sensor are arranged at the back and front ends of the body, and outputs of the ultrasonic distance measurement sensor and the laser distance measurement sensor are connected with the central processing module; the output of the central processing module is connected with the motion control module; the output of
the central processing module is bi directionally connected with the wireless communication module.
Although the system disclosed above uses sensors but the overall system is very complex and hence expensive which makes it unsuitable for grass root user.
In contrast, the present device is low cost, fulfills the objective of being affordable and industrially applicable.
CN201076033 Y The devices of the patent applications as referred are only capable of telling 'distance' from only 'one' direction due to presence of only ES2367059 (Al) One' ultrasonic sensor.
In comparison, in the present invention, sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
US20130039152 The device of the patent application has a fixed and defined plane for mounting two sensors.
In comparison, in the present invention, sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
CN 202844047 U The devices of the patent application is based on multiple sensors connected with the blind walking aid especially a hat which has embedded circuit device comprising of a base plate power supply module, an ultrasonic module main control module , voice outputting module to transmit voice information to the user.
In comparison, in the present invention, sensors are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle. The device uses haptic feedback system and no voice outputting module is
required.
US5047994 (A) The patent application referred here is a supersonic bone conduction hearing aid that receives conventional audiometric frequencies and converts them to supersonic frequencies for connection to the human sensory system by vibration bone conduction.
In contrast, the device of the present application uses haptic feedback system and no voice outputting module is required. It uses sensors and no audio frequencies are received or transmitted.
US2010278012 Both the referred patent uses audio frequency range as receiver or (Al) and transmitter.
US4761770 (A)
In contrast, the device of the present application uses haptic feedback system and no voice outputting module is required. It uses sensors and no audio frequencies are received or transmitted.
CN201591719 (U) The utility models referred here provide intelligent blind aid system WO2006074993 and an intelligent blind aid either in the form of cane or goggles or (A2) waist bands. Most of these provide intelligent blind aid cane; a first
US6671226 (Bl) ultrasonic range acquisition module is arranged at the middle of the US6198395 (Bl) cane; the ultrasonic transmitting head of the first ultrasonic range WO9740403 (Al) acquisition module faces to the front for detecting obstacles ahead; a WO9600401 (Al) second ultrasonic range acquisition module is arranged at the upper US4712003 (A) part of the cane; the ultrasonic transmitting head of the second US4280204 (A) ultrasonic range acquisition module faces upwards to the front for EP0008455 (Bl) detecting obstacles in a front upper place; an infrared range acquisition module is arranged at the lower part of the cane at the vertical distance of 2-30 cm to the ground; and the infrared transmitting head faces to the front for detecting low obstacles on the ground.
In contrast, the device of the present application uses haptic feedback system. It neither is a cane nor uses infrared frequencies.
WO9740403 (Al) The device of the patent application is a personal object detector
using continuous transmission frequency modulation and an audio output device.
In contrast, the device of the present application uses haptic feedback system.
MX2009001705 The devices of the patent applications have fixed and defined plane (A) and for mounting two sensors.
GB2448166 (A)
In comparison, in the present invention, sensors are detachable and attachable with the help of spring fit, clip fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle.
WO2007084122 The devices of the patent applications are used for determining the (A3) and direction of an acoustic highlight, comprising receiving US2006098533 backscattered, analog, ultrasonic sound-pressure pulses at the (Al) microphones of said acoustic vector probe; converting said backscattered analog ultrasonic sound-pressure pulses simultaneously into digital form and inputting these signals into said digital signal processor; lowering the frequency of said backscattered ultrasonic sound-pressure pulses to the audible range by heterodyning thereby highlighting the source of backscattered ultrasonic pulses.
In contrast, the device of the present application uses haptic feedback system rather than audio output.
US2009122648 The referred patent applications use wide-band sonar system as a (Al), mobility aid by the visually impaired. The system includes an
WO2008086178 acoustic source and a pair of miniature microphone arrays with (Al) and frequency-dependent beam patterns designed to mimic the properties US6469956 (Bl) of the human ear. Each microphone is preferably mounted near a respective ear of the user. The acoustic source and microphone arrays are mounted on the user's head so that the system will always be aligned therewith-as an example, they may be mounted near the user's ears on conventional eyeglass frames or a similar mounting device. Then each ear of the human receives measurement
information.
In contrast, the device of the present application uses haptic feedback system rather than audio output.
CN201076033 (Y) The utility model relates to a glove which uses ultrasound to achieve obstacle prompt for blind, the structure comprises a first isolation sheet metal , an ultrasound emission probe , an ultrasound receiving transducer and a vibration motor , wherein the first isolation sheet metal is sleeved on a fourth and a fifth finger portions of the glove , the ultrasound emission probe, the ultrasound receiving transducer and the vibration motor are arranged on the first isolation sheet metal, one end of a connecting line is connected with the ultrasound emission probe, the ultrasound receiving transducer and the vibration motor, and the other end is connected with a circuit board which is equipped with a power interface. The device is capable of probing the distance of an obstacle on a road and transforms the distance messages of the obstacle into vibration to prompt the bind. He is capable of judging the distance of the obstacle in accordance with change in strength of the probe.
Although the system disclosed above uses ultrasonic sensors as well as haptic feedback but the present device has sensors that are detachable and attachable with the help of spring fit arrangement or the like, thus can be mounted at the fingertips, thumb or at any area in the hand, thereby making the device capable of covering any angle and any direction.
Hence it is clear that none of the available patents are able to achieve the desired results of the present invention.
OBJECT OF THE PRESENT INVENTION:
1. The main object of the present invention is to disclose a hand wearable haptic feedback based navigation device which has the flexibility of attachment and detachment of the navigation sensors.
2. Another object of the invention is to disclose a hand wearable haptic feedback based navigation device which has the flexibility of sensing the distance of the obstacle in multiple directions covering a maximum of 180 degree field of view in the direction in which the hand is pointing.
3. Yet another object of the present invention is to disclose a hand wearable haptic feedback based navigation device which constantly transmits the distance of an obstacle to an external high performance device via wired or wireless communication after combining it with a 10 degrees of freedom Inertial measurement sensor that senses the special orientation of the hand with respect to the distance measured. Hence producing a 3D image of the objects/area in front in the form of a 3D graph.
SUMMARY OF THE INVENTION:
In the present exemplary embodiment, the present invention consists of distance sensors mounted on the gloves at the position of the finger tips. These sensors sense the distance of any hindrance, obstacles etc. from the finger's tip and transmit them to the microcontroller which is embedded in the glove itself. The microcontroller accordingly drives the vibration motors embedded in the glove. Since there are 5 fingers; all in different direction which when opened in full stretch make an angle of roughly 180 degrees, every finger tells the distance of obstacle in its direction.
BRIEF DESCRIPTION OF DRAWINGS:
FIGURE 1: Block diagram of present invention
Numberin :
1. Distance sensor unit, it may be ultrasonic based, infrared based, laser based or any distance sensing device. For 5 fingers there are five such sensors.
2. 10 degrees of freedom Inertial measurement sensor
3. Arduino or any low power based microcontroller unit
4. Wireless or wired transmission device
5. High performance device (IOS, android based mobile platforms, computers, laptops or any other high performance device).
6. 3D output device
7. A wireless signal transmitter
8. Arduino or any other MCU
9. Distance calibrator
10. Logic circuit for Distance = 0-33% of the maximum distance or any set category.
11. First Vibrator
12. Logic circuit for Distance = 33-66 of the maximum distance or any set category.
13. Vibrator 2 powered ON on that particular finger.
14. Logic circuit for Distance 66-99% of the maximum distance or any set category.
15. Vibrator 3 powered ON on that particular finger. FIGURE 2: Present embodiment as a glove
Numbering :
100. Vibrators or any other haptic feedback generating device.
101. Distance sensors
102. Battery pack, may or may not be disposed on hand though
103. Bug and error detection unit
104. Arduino or any other capable microcontroller unit or even a circuit
105. 10 degrees of freedom Inertial measurement sensor along with wireless or wired transmission unit.
FIGURE 3: Hand pointing in two axis at a time
FIGURE 4: Hand pointing in three axis at a time FIGURE 5: Hand pointing in one axis 180 degrees
FIGURE 6: Hand pointing in downward direction
DETAILED DESCRIPTION OF THE INVENTION:
When a person is not using his eyes for sensing distance, there are two practical alternate means to achieve distance sensing i.e. hearing or touch. Auditory (hearing) system, generally being able to process only one sound at a time makes it difficult for the user to understand any auditory signal that informs the presence of more than one obstacle and it's direction at the very same time.
Also if the person is using a pair of headphones as a part of the obstacle detection device, he might not be able to hear the horn of an approaching car or a whistle of a police man etc. at the same point of time resulting in accidents or injuries. Hence we may conclude that headphones set a barter agreement somewhere between sight and hearing as the user is neither able to hear clearly not able to see (if he is blind).
Speaker based audio feedback is evidently not practical in already noisy places and may prove to be disturbing in places where silence needs to be maintained. The present invention uses the other alternative of using touch sense to detect distance. Referring fig 2, in the present exemplary embodiment, the inventor has designed and developed special pair of gloves which is provided with attachable and detachable distance sensors (101) along with a microcontroller (104) embedded in the glove itself. The present invention is powered by a battery pack (102) which may or may not be disposed on hand though, a bug and error detection unit (103) for detecting any electronic, mechanical or software malfunction. Also provided is a 10 degrees of freedom Inertial measurement sensor unit (105) along with wireless or wired transmission unit.
The mechanism used for attachment and detachment can be any mechanism like stretchable wire loop fitted with sensor and made of elastic or any other suitable material or clip fit mechanism or any other mechanism that can let the distance sensing unit to be fixed on the finger and may or may also allow the user to rotate them about the fixed point. In the present embodiment, the inventor has shown already stretched and fitted sensors (101) at the position of the finger tips. These sensors sense the distance of any hindrance, obstacles etc. from the fingers tip and signals the microcontroller (104). Since there are 5 fingers all in different direction which when opened in full stretch, cover an angle of approximately 180 degrees, every finger is capable of sensing the distance of obstacle in its direction thereby covering multiple directions. Since the direction of the sensors can be fully controlled by the
user by pointing his finger to any direction, there is no limitation of sensing any particular direction.
WORKING OF THE DEVICE WITH REFERENCE TO FIG 1 AND 2:
1. Every finger is equipped with distance sensors (101) and three vibrators (100 of fig 2 or 11, 13, 15 of fig 1) for providing haptic feedback to the user; the user may use more or less vibrators on the finger depending on his sensing capability. To improve the reliability and ruggedness, every finger has a dedicated on board microcontroller (104) so that in case of failure of one, the rest can work.
2. The vibrators (100 of fig 2 or 11, 13, 15 of fig 1) are calibrated with respect to the distance of an obstacle from the user with the help of logic circuits (10, 12, 14 of Fig 1) in the MCU (104). Thus the following logic works:
a) When the obstacle is 0-50 cm ( or any distance category assigned by the user), is close and is about to hit the user, logic circuit (10) gives output which powers up first vibrator (11 of Fig 1) and it starts vibrating.
b) When the obstacle is 50-200 cm ( or any distance category assigned by the user) , is close to the user, logic circuit (12) gives output which powers up first vibrator (13 of Fig 1) and it starts vibrating.
c) When the obstacle is 200-400 cm ( or any distance category assigned by the user), far away from the user, logic circuit (14) gives output which powers up first vibrator (15 of Fig 1) and it starts vibrating. 3. In a preferred embodiment, input from 10 degrees of freedom Inertial measurement sensor unit (105 of Fig 2 or 2 of fig 1) is also fed to the onboard microcontroller (104 of Fig 2). This performs the usual task with the vibrators but along with it also sends the data of distance sensed by all the distance sensors and the direction and position of the hand sensed via 10 degrees of freedom Inertial measurement sensor (105 of Fig 2 or 2 of fig 1) to a wireless or wired signal transmitter ( 4 of fig 1) working as a high performance device. This device may be a mobile, laptop or any other high performance portable or non-portable.
4. The high performance device ( 4 of fig 1) receives the 'direction and spacial orientation of hand' and the distance of the obstacle from the distance sensors and plots that in the form of
a graph on 3D output device ( 6 of fig 1) . The hand now works like a bionic scanner. As the user moves the hand in random directions the graph gets plotted. Every direction has a coordinate on the 10 degrees of freedom Inertial measurement sensor therefore speed, randomness etc. does not affect the graph.
5. This graph can be saved or plotted on a high performance machine by sending the data through wireless signal transmitter (7 of fig 1) to an external display, projector etc.
The above description makes this device applicable to be used by soldiers or police also who have to work in dark at times to fight the enemy. Since the valuable data including direction, distance, shape, size etc in the form of 2D or 3D graph , can be transmitted to distant location also using wireless transmission unit (7 of fig 1), it may be received at a distant location using a receiver.
More detailed view can be achieved by combining sensors such as infrared sensors, PIR sensors and night vision. The distance may be also be mapped via high performance laser sensors and the user may be able to map an entire locality from a suitable height with greatest accuracy.
6. In yet another embodiment, two sensors can be mounted , one each at the top and bottom of the hand to sense stairs (ascending/descending), pits and sudden irregularities in the path.
These sensors mounted on the top and bottom work in a similar manner and share a single MCU. There are two vibrators (100), one for the upper part of the hand and the other for lower part of the hand respectively. The vibrators (100) on the lower hand are calibrated in such a way so as to indicate an ascending stair, descending stair, sudden pit or a sudden elevation. Similarly, the upper vibrators are calibrated in such a way so as to indicate a thin obstacle or a major big obstacle at the head level.
7. In one more embodiment, the sensors may have on board micro controller and may be integrally strapped on two or more individual fingers.
NOVELTY:
As is clear from the above discussion that none of the prior art patents have overcome the drawbacks of being non portable, workable only in closed system environment, direction sensing possibility of either one or two axis and high complexity and high cost of the device. The inventor came out with a novel solution to these problems by designing and developing a hand wearable haptic feedback based navigation device for distance sensing which has the flexibility of attachment and detachment of the navigation sensors and has the flexibility of sensing the distance of the obstacle in multiple directions covering a span of 0-180 degrees in the direction in which the hand is pointed.
The microcontroller used is Arduino which is an open source chip thereby making the device workable in any generic mode and customizable according to the user's demand. The device of present invention is less complex, easy to manufacture, is low cost and is user friendly. Also, the unique concept of using a 10 degrees of freedom Inertial measurement sensor in combination with sensors and vibrators, converting the data received into graphs and maps, providing capability of transmitting the data to a remote location, makes it a versatile device for navigation . None of the available prior art patents have provided solution of this kind, thus the invention is novel in itself.
INVENTIVE STEP:
The first inventive step lies in haptic feedback which is not specific to the hand but to every finger. This renders obstacles 5 directions to be sensed at a time. The second inventive step is to incorporate a 10 degrees of freedom Inertial measurement sensor to sense the spacial orientation of the hand. This eventually makes it possible to 3D map the view in front just by random hand movements. The third inventive step involves making the sensors detachable. This ensures that while the user needs lower accuracies in distance measurement he can free up fingers for normal use.
The final inventive step is the design. Firstly all the components are SMD and no moving parts are there such as servos etc. This manifests a robust design. Secondly the whole setup is wearable so the person need not carry it. Thirdly there is no tasking on the locomotive and auditory dexterity of the user as there is no audio feedback involved.
INDUSTRIAL APPLICATION:
The distance sensing device can be used successfully by blind as an aid while walking on road or on staircase. The same device can also be used by the soldiers in dark war field. They can simply wear this device and feel the vibration or view a 3D or 2D graph of what is in front.
Another application is in the field of animal study where the researchers have to watch the movement of animals in a jungle during night.
Therefore, the present invention finds application in any field where distance sensing is required without use of normal eye sight. The device is low cost and can be manufactured at an industrial scale with great ease.
Hence the industrial applicability of the present invention is quite obvious.
In the preceding detailed description, the invention is described with reference to exemplary drawings thereof. Various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the description. The specification and drawings are accordingly, to be regarded in an illustrative rather than a restrictive sense. Thus without analysis, the foregoing will so fully reveal the gist of the present invention that others can, by applying current knowledge, readily adapt it for various
applications without omitting features that from the standpoint of prior art, fairly constitute essential characteristics of the generic or specific aspects of this invention.
Claims
1. A hand wearable haptic feedback based navigation device comprising: - distance sensing unit (1) mounted at the finger tip of each finger;
- Arduino microcontroller (3), one for each finger, embedded in the device itself;
- haptic feedback generating device (100) , one for each finger to produce haptic output in the finger of the user;
- a 10 degrees of freedom Inertial measurement sensor (IMU) (2);
- wireless or wired signal transmitter(4);
- a battery pack (102);
- a bug and error detection unit (103) wherein the same is capable of :
- multi directional distance sensing covering maximum of 180 degrees;
- sensing different distance ranges;
- providing wireless or wired signals to remote locations.
2. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein multi directional distance sensing covering 180 degrees is achieved by using an attachment and detachment system with each sensor.
3. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein different distance ranges are achieved by calibrating each distance sensing unit (1) at a different distance sensing range.
4. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein wireless or wired signals to remote locations is achieved using wireless or wired signal transmitter (4) along with a 10 degrees of freedom Inertial measurement sensor (IMU) (2).
5. An attachment and detachment system as claimed in claim 2 wherein the same can be in the form of stretchable wire loop fitted with each distance sensing unit (1) or a clip fit mechanism or any other workable mechanism to attach and detach the distance sensing unit ( 1 ) to the part of hand.
6. An attachment and detachment system as claimed in claim 2 wherein this system can be made of elastic or any other material suitable for such functioning.
7. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein the distance sensing unit (1) comprises ultrasonic, infrared , PIR , night vision or laser sensors in stand alone or in any combination.
8. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein additional sensors and vibrators can also be mounted one each at the top and bottom of the hand respectively to sense stairs (ascending/descending), pits and sudden irregularities in the path.
9. A hand wearable haptic feedback based navigation device as claimed in claim 1 wherein the haptic feedback generating device (100) can be a vibrator or any other device capable of producing haptic feedback.
10. A hand wearable haptic feedback based navigation device and attachment and detachment system as claimed in claims 1-9 wherein the sensors may have on board micro controller and may be integrally strapped on two or more individual fingers.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IN3506/DEL/2013 | 2013-12-03 | ||
IN3506DE2013 | 2013-12-03 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2015083183A1 true WO2015083183A1 (en) | 2015-06-11 |
WO2015083183A4 WO2015083183A4 (en) | 2016-02-25 |
Family
ID=52595384
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IN2014/000742 WO2015083183A1 (en) | 2013-12-03 | 2014-12-01 | Hand wearable haptic feedback based navigation device |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015083183A1 (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9753539B2 (en) | 2014-10-02 | 2017-09-05 | Futureplay Inc. | Method, device, system and non-transitory computer-readable recording medium for providing user interface |
US9792501B1 (en) * | 2016-12-31 | 2017-10-17 | Vasuyantra Corp. | Method and device for visually impaired assistance |
IT201600079587A1 (en) * | 2016-07-28 | 2018-01-28 | Glauco Letizia | EQUIPMENT AND METHOD OF SENSORY REPLACEMENT (S.S.D.) TO ASSIST A NON-VISITING PERSON IN WALKING, ORIENTATION AND UNDERSTANDING OF INTERNAL ENVIRONMENTS. |
CN107643523A (en) * | 2017-10-27 | 2018-01-30 | 深圳市亿兆互联技术有限公司 | A kind of multichannel ultrasonic guide arm device and its application method |
US10046234B2 (en) | 2015-10-20 | 2018-08-14 | OBE Gaming Inc. | Interactive movement tracking system applicable to articles of clothing |
US20180239428A1 (en) * | 2016-12-31 | 2018-08-23 | Vasuyantra Corp., A Delaware Corporation | Remote perception of depth and shape of objects and surfaces |
US10210723B2 (en) | 2016-10-17 | 2019-02-19 | At&T Intellectual Property I, L.P. | Wearable ultrasonic sensors with haptic signaling for blindside risk detection and notification |
CN109596123A (en) * | 2018-12-07 | 2019-04-09 | 湖北航天飞行器研究所 | A kind of wearable human body temperature type navigation communication means |
US10322336B2 (en) | 2017-02-01 | 2019-06-18 | Microsoft Technology Licensing, Llc | Haptic braille output for a game controller |
US10371544B2 (en) | 2017-05-04 | 2019-08-06 | Wearworks | Vibrating haptic device for the blind |
WO2019156990A1 (en) * | 2018-02-09 | 2019-08-15 | Vasuyantra Corp., A Delaware Corporation | Remote perception of depth and shape of objects and surfaces |
US10384137B2 (en) | 2017-02-01 | 2019-08-20 | Microsoft Technology Licensing, Llc | Braille chording accessory for a game controller |
US10463978B2 (en) | 2017-02-01 | 2019-11-05 | Microsoft Technology Licensing, Llc | Refreshable braille display accessory for a game controller |
US10959674B2 (en) | 2017-10-23 | 2021-03-30 | Datafeel Inc. | Communication devices, methods, and systems |
US20220008252A1 (en) * | 2020-07-13 | 2022-01-13 | Jacob Roman Donnini | Wireless extra-sensory location supplementary for navigation of the visually impaired |
CN114903757A (en) * | 2022-01-26 | 2022-08-16 | 丁龙全 | A wearable blind guidance system and method of using the same |
WO2023286020A1 (en) * | 2021-07-15 | 2023-01-19 | Fundação Noras | System and method for providing feedback to a user |
US11881096B2 (en) | 2019-12-18 | 2024-01-23 | Koninklijke Philips N.V. | System and method for performing mobility management using haptic guidance |
US11934583B2 (en) | 2020-10-30 | 2024-03-19 | Datafeel Inc. | Wearable data communication apparatus, kits, methods, and systems |
RU2834837C1 (en) * | 2024-02-02 | 2025-02-14 | Федеральное Государственное Бюджетное Образовательное Учреждение Высшего Образования "Новосибирский Государственный Технический Университет" | Three-channel ultrasonic assistive assistant for visually impaired persons |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105963109A (en) * | 2016-05-04 | 2016-09-28 | 天津商业大学 | Obstacle-avoidance bracelet circuit system for blind person |
CN108830541A (en) * | 2018-04-18 | 2018-11-16 | 链家网(北京)科技有限公司 | Issue management method and management system on a kind of line |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6115482A (en) * | 1996-02-13 | 2000-09-05 | Ascent Technology, Inc. | Voice-output reading system with gesture-based navigation |
US20020012014A1 (en) * | 2000-06-01 | 2002-01-31 | Olympus Optical Co., Ltd. | Operation input apparatus using sensor attachable to operator's hand |
WO2008112519A1 (en) * | 2007-03-12 | 2008-09-18 | University Of Pittsburgh - Of The Commonwealth System Of Higher Education | Fingertip visual haptic sensor controller |
-
2014
- 2014-12-01 WO PCT/IN2014/000742 patent/WO2015083183A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6115482A (en) * | 1996-02-13 | 2000-09-05 | Ascent Technology, Inc. | Voice-output reading system with gesture-based navigation |
US20020012014A1 (en) * | 2000-06-01 | 2002-01-31 | Olympus Optical Co., Ltd. | Operation input apparatus using sensor attachable to operator's hand |
WO2008112519A1 (en) * | 2007-03-12 | 2008-09-18 | University Of Pittsburgh - Of The Commonwealth System Of Higher Education | Fingertip visual haptic sensor controller |
Cited By (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9753539B2 (en) | 2014-10-02 | 2017-09-05 | Futureplay Inc. | Method, device, system and non-transitory computer-readable recording medium for providing user interface |
US10046234B2 (en) | 2015-10-20 | 2018-08-14 | OBE Gaming Inc. | Interactive movement tracking system applicable to articles of clothing |
IT201600079587A1 (en) * | 2016-07-28 | 2018-01-28 | Glauco Letizia | EQUIPMENT AND METHOD OF SENSORY REPLACEMENT (S.S.D.) TO ASSIST A NON-VISITING PERSON IN WALKING, ORIENTATION AND UNDERSTANDING OF INTERNAL ENVIRONMENTS. |
US11386758B2 (en) | 2016-10-17 | 2022-07-12 | At&T Intellectual Property I, L.P. | Wearable ultrasonic sensors with haptic signaling for blindside risk detection and notification |
US10210723B2 (en) | 2016-10-17 | 2019-02-19 | At&T Intellectual Property I, L.P. | Wearable ultrasonic sensors with haptic signaling for blindside risk detection and notification |
US9792501B1 (en) * | 2016-12-31 | 2017-10-17 | Vasuyantra Corp. | Method and device for visually impaired assistance |
US20180239428A1 (en) * | 2016-12-31 | 2018-08-23 | Vasuyantra Corp., A Delaware Corporation | Remote perception of depth and shape of objects and surfaces |
US10782780B2 (en) * | 2016-12-31 | 2020-09-22 | Vasuyantra Corp. | Remote perception of depth and shape of objects and surfaces |
US10322336B2 (en) | 2017-02-01 | 2019-06-18 | Microsoft Technology Licensing, Llc | Haptic braille output for a game controller |
US10463978B2 (en) | 2017-02-01 | 2019-11-05 | Microsoft Technology Licensing, Llc | Refreshable braille display accessory for a game controller |
US10384137B2 (en) | 2017-02-01 | 2019-08-20 | Microsoft Technology Licensing, Llc | Braille chording accessory for a game controller |
US10371544B2 (en) | 2017-05-04 | 2019-08-06 | Wearworks | Vibrating haptic device for the blind |
US12036174B1 (en) | 2017-10-23 | 2024-07-16 | Datafeel Inc. | Communication devices, methods, and systems |
US11864913B2 (en) | 2017-10-23 | 2024-01-09 | Datafeel Inc. | Communication devices, methods, and systems |
US10959674B2 (en) | 2017-10-23 | 2021-03-30 | Datafeel Inc. | Communication devices, methods, and systems |
US12318220B2 (en) | 2017-10-23 | 2025-06-03 | Datafeel Inc. | Communication devices, systems and methods |
US12318221B2 (en) | 2017-10-23 | 2025-06-03 | Datafeel Inc. | Communication devices, systems and methods |
US12193840B1 (en) | 2017-10-23 | 2025-01-14 | Datafeel Inc. | Communication devices, methods, and systems |
US11484263B2 (en) | 2017-10-23 | 2022-11-01 | Datafeel Inc. | Communication devices, methods, and systems |
US12097161B2 (en) | 2017-10-23 | 2024-09-24 | Datafeel Inc. | Communication devices, methods, and systems |
US11589816B2 (en) | 2017-10-23 | 2023-02-28 | Datafeel Inc. | Communication devices, methods, and systems |
US11684313B2 (en) | 2017-10-23 | 2023-06-27 | Datafeel Inc. | Communication devices, methods, and systems |
US11864914B2 (en) | 2017-10-23 | 2024-01-09 | Datafeel Inc. | Communication devices, methods, and systems |
US11931174B1 (en) | 2017-10-23 | 2024-03-19 | Datafeel Inc. | Communication devices, methods, and systems |
CN107643523B (en) * | 2017-10-27 | 2024-10-18 | 上海亿道电子技术有限公司 | Multichannel ultrasonic waveguide blind hand device and application method thereof |
CN107643523A (en) * | 2017-10-27 | 2018-01-30 | 深圳市亿兆互联技术有限公司 | A kind of multichannel ultrasonic guide arm device and its application method |
WO2019156990A1 (en) * | 2018-02-09 | 2019-08-15 | Vasuyantra Corp., A Delaware Corporation | Remote perception of depth and shape of objects and surfaces |
CN109596123A (en) * | 2018-12-07 | 2019-04-09 | 湖北航天飞行器研究所 | A kind of wearable human body temperature type navigation communication means |
US11881096B2 (en) | 2019-12-18 | 2024-01-23 | Koninklijke Philips N.V. | System and method for performing mobility management using haptic guidance |
US20220008252A1 (en) * | 2020-07-13 | 2022-01-13 | Jacob Roman Donnini | Wireless extra-sensory location supplementary for navigation of the visually impaired |
US11934583B2 (en) | 2020-10-30 | 2024-03-19 | Datafeel Inc. | Wearable data communication apparatus, kits, methods, and systems |
WO2023286020A1 (en) * | 2021-07-15 | 2023-01-19 | Fundação Noras | System and method for providing feedback to a user |
CN114903757A (en) * | 2022-01-26 | 2022-08-16 | 丁龙全 | A wearable blind guidance system and method of using the same |
RU2834837C1 (en) * | 2024-02-02 | 2025-02-14 | Федеральное Государственное Бюджетное Образовательное Учреждение Высшего Образования "Новосибирский Государственный Технический Университет" | Three-channel ultrasonic assistive assistant for visually impaired persons |
Also Published As
Publication number | Publication date |
---|---|
WO2015083183A4 (en) | 2016-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2015083183A1 (en) | Hand wearable haptic feedback based navigation device | |
US10371544B2 (en) | Vibrating haptic device for the blind | |
Bousbia-Salah et al. | A navigation aid for blind people | |
CN105748265B (en) | Navigation device and method | |
Jones et al. | Tactile displays: Guidance for their design and application | |
Dakopoulos et al. | Wearable obstacle avoidance electronic travel aids for blind: a survey | |
JP6599877B2 (en) | Smart necklace with stereoscopic view and internal processing function | |
Tapu et al. | A survey on wearable devices used to assist the visual impaired user navigation in outdoor environments | |
US20140184384A1 (en) | Wearable navigation assistance for the vision-impaired | |
US11086392B1 (en) | Devices, systems, and methods for virtual representation of user interface devices | |
EP3576427B1 (en) | Haptics device for producing directional sound and haptic sensations | |
KR102351584B1 (en) | System for providing navigation service for visually impaired person | |
Dunai et al. | Obstacle detectors for visually impaired people | |
US20160321955A1 (en) | Wearable navigation assistance for the vision-impaired | |
US10900788B2 (en) | Wearable navigation system for the visually impaired | |
JP6150429B2 (en) | Robot control system, robot, output control program, and output control method | |
Zhou et al. | A smart\" virtual eye\" mobile system for the visually impaired | |
Sharma et al. | Design of micro controller Based Virtual Eye for the Blind | |
JPWO2020105309A1 (en) | Information processing equipment, information processing methods, and programs | |
Chaccour et al. | Novel indoor navigation system for visually impaired and blind people | |
Jones et al. | Localization and pattern recognition with tactile displays | |
Bolla et al. | Object detection in computer vision using machine learning algorithm for visually impaired people | |
Singh et al. | A survey of current aids for visually impaired persons | |
KR100563193B1 (en) | Gait guidance device and method for converting visual information for hearing and tactile information for indoor / outdoor gait of the visually impaired | |
US20220296455A1 (en) | Clothing item |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14841334 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14841334 Country of ref document: EP Kind code of ref document: A1 |