[go: up one dir, main page]

CN110496018A - Method, wearable device and the storage medium of wearable device guide blind person - Google Patents

Method, wearable device and the storage medium of wearable device guide blind person Download PDF

Info

Publication number
CN110496018A
CN110496018A CN201910656864.1A CN201910656864A CN110496018A CN 110496018 A CN110496018 A CN 110496018A CN 201910656864 A CN201910656864 A CN 201910656864A CN 110496018 A CN110496018 A CN 110496018A
Authority
CN
China
Prior art keywords
wearable device
target object
information
blind person
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910656864.1A
Other languages
Chinese (zh)
Inventor
黄艳荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201910656864.1A priority Critical patent/CN110496018A/en
Publication of CN110496018A publication Critical patent/CN110496018A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means

Landscapes

  • Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • Pain & Pain Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Rehabilitation Therapy (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a kind of methods that wearable device guides blind person, wearable device and storage medium, this method obtains the image that camera currently acquires, and image is identified, according to image or image and positioning is combined to obtain target information, target information is issued by voice prompting, to guide blind person, it solves single to the information of the guiding function acquisition of blind person in wearable device, and the problem of needing special equipment, the invention also discloses a kind of wearable device and storage mediums, by implementing above scheme, life guide is carried out to blind person using the camera of wearable device or the other function of combination wearable device, promote the effect that wearable device guides blind person.

Description

Method, wearable device and the storage medium of wearable device guide blind person
Technical field
The present invention relates to wearable device technical fields, guide blind person's more specifically to a kind of wearable device Method, wearable device and storage medium.
Background technique
With the extensive use of wearable device and the raising of network communication speed and smart machine information processing capability, Wearable device can be realized diversified function.For blind person, wearable device can become convenient backman Tool, but it is existing currently, wearable device is single for the information of the guiding function of blind person, it can only often provide and simply navigate or keep away Barrier prompt, and blind person generally requires to wear the wearable device specifically for blind person.In the related technology, it utilizes commonly Camera and positioning function in wearable device realize guide of more living to blind person.
Summary of the invention
The technical problem to be solved in the present invention is that: the user experience that blind person is guided using wearable device is improved, For the technical problem, method, wearable device and the storage medium of a kind of wearable device guide blind person are provided.
In order to solve the above technical problems, the present invention provides a kind of method that wearable device guides blind person, it is described wearable Equipment includes that camera includes:
The wearable device includes camera;
It obtains the image that camera currently acquires and identifies the target object in described image;
Obtain the current location information of user;
Target information is obtained from described image or obtains the target information in conjunction with described image and the location information;
The target information includes at least one of the following: the location information of the target object, the target object Essential information;
The location information of the target object includes at least one of the following: the geographical location of the target object, institute State position, target object position relative to other objects of the target object relative to user;
According to the target information, voice prompting is issued, and store-memory is carried out to the location information.
Optionally, the target information is obtained from described image or obtains mesh in conjunction with described image and the location information Marking information includes:
At least one of following information is obtained according to described image: position of the target object relative to user, institute Target object is stated relative to the position of other objects, the essential information of the target object;
The geographical location of the target object is obtained in conjunction with described image and the location information.
Optionally, the combination described image and the location information obtain the geographical location of the target object and include:
Position according to the current location information of the user and the target object relative to user calculates described The geographical location of target object.
Optionally, the wearable device includes: to location information progress store-memory
When position of the geographical location, the target object in the target information including the target object relative to user It sets, when the target object is relative at least one in the position of other objects, the wearable device is to the target pair The geographical location of elephant, the target object are relative to the position of user, the target object relative in the position of other objects At least one carry out store-memory.
Optionally, the method that the wearable device guides blind person further include:
Whether detection user issues the instruction of the searching to the target object;
If user issues the searching to the target object and instructs, according to the institute of store-memory in the wearable device The location information for stating target object sends voice prompting.
Optionally, whether the method that the wearable device guides blind person further includes detecting the wearable device and opening to lead Boat function;
If detecting, the wearable device opens navigation feature, and the transmission time interval of the voice prompting is less than the One threshold value;
In first threshold time interval after the voice prompting transmission, do not have in the described image that the camera obtains The target object then sends the speech prompt information that the road is clear;
If the network turn-off time of the wearable device is greater than second threshold, the voice prompting letter of network interruption is sent Breath.
Optionally, the target object includes: barrier, pit-hole, traffic lights, automobile, pedestrian, the target object Essential information include: the target object size;
When the target object is automobile or pedestrian, the essential information of the target object further include: the target pair The motion state of elephant;
When the target object is traffic lights, the essential information of the target object further include: the traffic letter The signal condition of signal lamp.
Optionally, if detecting in described image when there is no blind way or traffic lights, in the wearable device The location information of store-memory is retrieved, and is judged in the third threshold range of user current location with the presence or absence of described blind Road or the traffic lights, if judging, there are the blind way or the traffic in the third threshold range of user current location Signal lamp then sends the position indicating information of the blind way or the traffic lights.
Further, the present invention also provides a kind of wearable devices, and the wearable device includes camera, described to wear Wear equipment further include:
Processor, memory, communication bus;
The communication bus connects the processor and the memory;
Computer program code is stored in the memory;
The processor calls the computer code stored in the memory to realize that above-mentioned wearable device guides The method of blind person.
Further, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium is deposited Contain the computer program that can be run on a processor, the computer program realized when being executed by the processor it is above-mentioned can The method of wearable device guide blind person.
Beneficial effect
The present invention provides method, wearable device and the storage medium of a kind of wearable device guide blind person, for existing The wearable device defect single to the information of the guiding function of blind person, by obtaining the image and identification that camera currently acquires Object in image, and obtain the location information of user, according to image or combine image and location information get to blind person into The target information that row guides issues the case where voice prompting helps blind person to grasp surrounding according to target information, meanwhile, it is capable to right The position of elephant carries out store-memory.
Wearable device is single for the information of the guiding function of blind person in the relevant technologies presence, thereby increases and it is possible to need for blind person Guide the problem of configuring special equipment.Relative to existing blind person's guidance method, present invention incorporates cameras and wearable The function of other modules in equipment, having makes wearable device carry out what preferably life was guided to blind person on the basis of camera Effect.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention Example, and be used to explain the principle of the present invention together with specification.
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, for those of ordinary skill in the art Speech, without any creative labor, is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of hardware structural diagram of embodiment of wearable device provided in an embodiment of the present invention;
Fig. 2 is a kind of hardware schematic of embodiment of wearable device provided in an embodiment of the present invention;
Fig. 3 is a kind of hardware schematic of embodiment of wearable device provided in an embodiment of the present invention;
Fig. 4 is a kind of hardware schematic of embodiment of wearable device provided in an embodiment of the present invention;
Fig. 5 is a kind of hardware schematic of embodiment of wearable device provided in an embodiment of the present invention;
Fig. 6 is the method basic flow chart that the wearable device that first embodiment of the invention provides guides blind person;
Fig. 7 is the method flow diagram that the wearable device that second embodiment of the invention provides guides blind person;
Fig. 8 is the method flow diagram that the wearable device that third embodiment of the invention provides guides blind person;
Fig. 9 is the structure chart for the wearable device that fourth embodiment of the invention provides;
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
In subsequent description, it is only using the suffix for indicating such as " module ", " component " or " unit " of element Be conducive to explanation of the invention, itself there is no a specific meaning.Therefore, " module ", " component " or " unit " can mix Ground uses.
The wearable device provided in the embodiment of the present invention includes that Intelligent bracelet, smartwatch and smart phone etc. move Dynamic terminal.With the continuous development of Screen Technology, the appearance of the screens form such as flexible screen, Folding screen, smart phone etc. is mobile eventually End can also be used as wearable device.The wearable device provided in the embodiment of the present invention may include: RF (Radio Frequency, radio frequency) unit, WiFi module, audio output unit, A/V (audio/video) input unit, sensor, display The components such as unit, user input unit, interface unit, memory, processor and power supply.
It will be illustrated by taking wearable device as an example in subsequent descriptions, referring to Fig. 1, its each implementation to realize the present invention A kind of hardware structural diagram of wearable device of example, which may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A/V (audio/video) input unit 104, Sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, Yi Ji electricity The components such as source 111.It will be understood by those skilled in the art that wearable device structure shown in Fig. 1 is not constituted to wearable The restriction of equipment, wearable device may include perhaps combining certain components or difference than illustrating more or fewer components Component layout.
It is specifically introduced below with reference to all parts of the Fig. 1 to wearable device:
Radio frequency unit 101 can be used for receiving and sending messages or communication process in, signal sends and receivees, specifically, radio frequency list Uplink information can be sent to base station by member 101, and after the downlink information that in addition can also be sent base station receives, being sent to can be worn The processor 110 for wearing equipment is handled, and base station can be to the downlink information that radio frequency unit 101 is sent and be sent out according to radio frequency unit 101 What the uplink information sent generated, it is also possible to actively push away to radio frequency unit 101 after the information update for detecting wearable device It send, for example, base station can penetrating to wearable device after detecting that geographical location locating for wearable device changes Frequency unit 101 sends the message informing of geographical location variation, and radio frequency unit 101, can should after receiving the message informing The processor 110 that message informing is sent to wearable device is handled, and it is logical that the processor 110 of wearable device can control the message Know on the display panel 1061 for being shown in wearable device;In general, radio frequency unit 101 include but is not limited to antenna, at least one Amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, radio frequency unit 101 can also pass through channel radio Letter communicated with network and other equipment, specifically may include: by wireless communication with the server communication in network system, example Such as, wearable device can download file resource from server by wireless communication, for example can download and answer from server With program, after wearable device completes the downloading of a certain application program, if the corresponding file of the application program in server Resource updates, then the server can be by wireless communication to the message informing of wearable device push resource updates, to remind User is updated the application program.Any communication standard or agreement can be used in above-mentioned wireless communication, including but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (Code Division Multiple Access 2000, CDMA 2000), (Wideband Code Division Multiple Access, wideband code division are more by WCDMA Location), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time division synchronous CDMA), (Frequency Division Duplexing-Long Term Evolution, frequency division duplex are long by FDD-LTE Phase evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, time division duplex are drilled for a long time Into) etc..
In one embodiment, wearable device 100 can access existing communication network by insertion SIM card.
In another embodiment, wearable device 100 can be come real by the way that esim card (Embedded-SIM) is arranged Existing communication network is now accessed, by the way of esim card, the inner space of wearable device can be saved, reduce thickness.
It is understood that although Fig. 1 shows radio frequency unit 101, but it is understood that, radio frequency unit 101 its And it is not belonging to must be configured into for wearable device, it can according to need within the scope of not changing the essence of the invention and save completely Slightly., wearable device 100 can realize the communication connection with other equipment or communication network separately through wifi module 102, The embodiment of the present invention is not limited thereto.
WiFi belongs to short range wireless transmission technology, and wearable device can help user to receive and dispatch by WiFi module 102 Email, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 1 WiFi module 102 is shown, but it is understood that, and it is not belonging to must be configured into for wearable device, it completely can root It is omitted within the scope of not changing the essence of the invention according to needs.
Audio output unit 103 can be in call signal reception pattern, call mode, record in wearable device 100 When under the isotypes such as mode, speech recognition mode, broadcast reception mode, by radio frequency unit 101 or WiFi module 102 it is received or The audio data that person stores in memory 109 is converted into audio signal and exports to be sound.Moreover, audio output unit 103 can also provide audio output relevant to the specific function that wearable device 100 executes (for example, call signal reception sound Sound, message sink sound etc.).Audio output unit 103 may include loudspeaker, buzzer etc..
A/V input unit 104 is for receiving audio or video signal.A/V input unit 104 may include graphics processor (Graphics Processing Unit, GPU) 1041 and microphone 1042, graphics processor 1041 is in video acquisition mode Or the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries out Reason.Treated, and picture frame may be displayed on display unit 106.Through graphics processor 1041, treated that picture frame can be deposited Storage is sent in memory 109 (or other storage mediums) or via radio frequency unit 101 or WiFi module 102.Mike Wind 1042 can connect in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone 1042 Quiet down sound (audio data), and can be audio data by such acoustic processing.Audio that treated (voice) data can To be converted to the format output that can be sent to mobile communication base station via radio frequency unit 101 in the case where telephone calling model. Microphone 1042 can be implemented various types of noises elimination (or inhibition) algorithms and send and receive sound to eliminate (or inhibition) The noise generated during frequency signal or interference.
In one embodiment, wearable device 100 includes one or more cameras, by opening camera, It can be realized the capture to image, realize the functions such as take pictures, record a video, the position of camera, which can according to need, to be configured.
Wearable device 100 further includes at least one sensor 105, for example, optical sensor, motion sensor and other Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ring The light and shade of border light adjusts the brightness of display panel 1061, proximity sensor can when wearable device 100 is moved in one's ear, Close display panel 1061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions The size of (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify mobile phone posture when static It (for example pedometer, is struck using (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function Hit) etc..
In one embodiment, wearable device 100 further includes proximity sensor, can by using proximity sensor Wearable device can be realized non-contact manipulation, provide more modes of operation.
In one embodiment, wearable device 100 further includes heart rate sensor, when wearing, by close to using Person can be realized the detecting of heart rate.
In one embodiment, wearable device 100 can also include that fingerprint sensor can by reading fingerprint Realize the functions such as safety verification.
Display unit 106 is for showing information input by user or being supplied to the information of user.Display unit 106 can wrap Display panel 1061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 1061.
In one embodiment, display panel 1061 uses flexible display screen, and wearable using flexible display screen sets For when wearing, screen is able to carry out bending, to more be bonded.Optionally, the flexible display screen can use OLED screen Body and graphene screen body, in other embodiments, the flexible display screen is also possible to other display materials, the present embodiment It is not limited thereto.
In one embodiment, the display panel 1061 of wearable device can take rectangle, ring when convenient for wearing Around.In other embodiments, other modes can also be taken.
User input unit 107 can be used for receiving the number or character information of input, and generate and wearable device User setting and the related key signals input of function control.Specifically, user input unit 107 may include touch panel 1071 And other input equipments 1072.Touch panel 1071, also referred to as touch screen collect the touch behaviour of user on it or nearby Make (for example user uses any suitable objects or attachment such as finger, stylus on touch panel 1071 or in touch panel Operation near 1071), and corresponding attachment device is driven according to preset formula.Touch panel 1071 may include touching Two parts of detection device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch behaviour Make bring signal, transmits a signal to touch controller;Touch controller receives touch information from touch detecting apparatus, and It is converted into contact coordinate, then gives processor 110, and order that processor 110 is sent can be received and executed.This Outside, touch panel 1071 can be realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touching Panel 1071 is controlled, user input unit 107 can also include other input equipments 1072.Specifically, other input equipments 1072 It can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operation One of bar etc. is a variety of, specifically herein without limitation.
In one embodiment, one or more buttons have can be set in the side of wearable device 100.Button can be with The various ways such as short-press, long-pressing, rotation are realized, to realize a variety of operating effects.The quantity of button can be different to be multiple It can be applied in combination between button, realize a variety of operating functions.
Further, touch panel 1071 can cover display panel 1061, when touch panel 1071 detect on it or After neighbouring touch operation, processor 110 is sent to determine the type of touch event, is followed by subsequent processing device 110 according to touch thing The type of part provides corresponding visual output on display panel 1061.Although in Fig. 1, touch panel 1071 and display panel 1061 be the function that outputs and inputs of realizing wearable device as two independent components, but in certain embodiments, Touch panel 1071 and display panel 1061 can be integrated and be realized the function that outputs and inputs of wearable device, specifically herein Without limitation.For example, processor 110 can be controlled when receiving the message informing of a certain application program by radio frequency unit 101 The message informing show in a certain predeterminable area of display panel 1061 by system, the predeterminable area and touch panel 1071 certain One region is corresponding, can be to corresponding to area on display panel 1061 by carrying out touch control operation to a certain region of touch panel 1071 The message informing shown in domain is controlled.
Interface unit 108 be used as at least one external device (ED) connect with wearable device 100 can by interface.Example Such as, external device (ED) may include wired or wireless headphone port, external power supply (or battery charger) port, You Xianhuo Wireless data communications port, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end Mouth, video i/o port, ear port etc..Interface unit 108 can be used for receiving the input from external device (ED) (for example, number It is believed that breath, electric power etc.) and the input received is transferred to one or more elements in wearable device 100 or can For transmitting data between wearable device 100 and external device (ED).
In one embodiment, wearable device 100 interface unit 108 using contact structure, by contact with Corresponding other equipment connection, realizes the functions such as charging, connection.Use contact can be with waterproof.
Memory 109 can be used for storing software program and various data.Memory 109 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, image player function etc.) etc.;Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory 109 may include high-speed random access memory, it can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 110 is the control centre of wearable device, utilizes various interfaces and the entire wearable device of connection Various pieces, by running or execute the software program and/or module that are stored in memory 109, and call and be stored in Data in memory 109 execute the various functions and processing data of wearable device, to carry out to wearable device whole Monitoring.Processor 110 may include one or more processing units;Preferably, processor 110 can integrate application processor and modulation Demodulation processor, wherein the main processing operation system of application processor, user interface and application program etc., modulation /demodulation processing Device mainly handles wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 110.
Wearable device 100 can also include the power supply 111 (such as battery) powered to all parts, it is preferred that power supply 111 can be logically contiguous by power-supply management system and processor 110, thus charged by power-supply management system realization management, The functions such as electric discharge and power managed.
Although Fig. 1 is not shown, wearable device 100 can also be including bluetooth module etc., and details are not described herein.It is wearable to set Standby 100, by bluetooth, can connect with other terminal devices, realize communication and the interaction of information.
Fig. 2-Fig. 4 is please referred to, is the structure under a kind of a kind of embodiment of wearable device provided in an embodiment of the present invention Schematic diagram.Wearable device in the embodiment of the present invention, including flexible screen.In wearable device expansion, flexible screen is in Strip;When wearable device is in wearing state, flexible screen bending is annular in shape.Fig. 2 and Fig. 3 show wearable device Structural schematic diagram when screen is unfolded, Fig. 4 show structural schematic diagram when wearable device screen-bending.
Based on above-mentioned each embodiment, it can be seen that if the equipment is wrist-watch, bracelet or wearable device When, the screen of the equipment can not overlay device watchband region, can also be with the watchband region of overlay device.Here, this hair Bright to propose a kind of optional embodiment, in the present embodiment, the equipment for wrist-watch, bracelet or wearable can be set Standby, the equipment includes screen and interconnecting piece.The screen can be flexible screen, and the interconnecting piece can be watchband.It can Choosing, the screen of the equipment or the viewing area of screen can be partly or completely covered on the watchband of equipment.Such as Fig. 5 Shown, Fig. 5 is a kind of a kind of hardware schematic of embodiment of wearable device provided in an embodiment of the present invention, the equipment Screen extends to two sides, and part is covered on the watchband of equipment.In other embodiments, the screen of the equipment can also be with It is all covered on the watchband of the equipment, the embodiment of the present invention is not limited thereto.
First embodiment
Fig. 6 is the method basic flow chart that wearable device provided in this embodiment guides blind person, which refers to The method for drawing blind person includes:
S601, it obtains the image that currently acquires of camera and identifies the target object in image.
Wearable device provided in this embodiment guides in the method for blind person, need to be acquired the image of camera with And the target object in identification image, target object referred herein refers to should be to the object that blind person is prompted, such as schemes The face that can recognize as in, the object in front, common article etc. in life, by identifying target object, it will be able to slap Hold many information under blind person's current environment.
S602, the location information for obtaining user
Wearable device can get the current location information of user there are many mode, can be by GPS, can also To utilize network, or even acquired image information in step S601 can also be used, trial has got off-position from image The information set.
S603, target information is obtained
In the present embodiment, the acquisition of target information is obtained by way of analysis image or using image combination location information It arrives.
It should be noted that target information can be the position of target object, it is also possible to some basic of target object Information, such as size, the moving condition of some object etc..
The position of target object can be any one or multiple location informations below: the geographical location of target object, That is the location information of GPS or location information etc;Position of the target object relative to user;Target object is relative to other objects Position.
Above each information can play effective help to the guide of blind person.
It is understood that obtaining at least one of following information: position of the target object relative to user according to image It sets, target object is relative to the position of other objects, the essential information of target object;
The geographical location of target object is obtained in conjunction with image and location information.
By image, can directly obtain target object relative to user location, relative to other objects position with And the information that shape of target object etc. is basic;And only in the picture, it cannot easily obtain the geographical location of target object, Therefore, the geographical location information of target object should judge in conjunction with the current location information of user.Current according to user The position of location information and target object relative to user, it will be able to the rough geographical position for calculating the target object It sets.
It is understood that if there are wearable device other to be able to detect the sensor of orientation or distance, such as away from From sensor, gyroscope etc., the geographical location of the measurement target object of the aggregation of data of other sensors can also be combined, so that Data are more accurate.
S604, voice prompting is issued according to target information, and store-memory is carried out to location information
After getting the target information of needs, voice signal is converted by target information, passes through loudspeaker, earphone etc. Speech ciphering equipment issues voice prompting, so that blind person understands current situation.
When position relative to user of geographical location, target object, the target object in target information including target object When relative at least one in the position of other objects, wearable device can geographical location to target object, target pair As at least one of the position of position, target object relative to other objects relative to user carries out store-memory.Certainly, When store-memory, some essential informations of target object can also be added, so that the deposit of information is more perfect.
Optionally, after completing to the store-memory of location information, user can issue the searching to target object Instruction can convert the position of the target object of store-memory after wearable device receives the instruction for finding target object Voice prompting is sent for voice signal;Or open the navigation for going to target object position.
Preset threshold value should be less than when voice prompting is sent when wearable device enables the function of navigation, this Sample can guarantee that blind person can constantly receive prompting, keep trip safer, also improve the sense of security of blind person.If default Threshold value in, there is no target object in the image of camera, or determine target object distance it is far, road can be sent Unobstructed prompt information;And if network disconnects, or other obstructions, which have occurred, causes information that cannot obtain or analyze in time Situation, and when suspension time or the situation continue for second preset threshold value, relevant warning indicators are issued, prevent blind person from missing Think that the road is clear and causes danger.
It should be understood that target object should include barrier, pit-hole, automobile, row in road during navigation The objects such as people, traffic lights, can also size, shape to target object judge;Further, can to automobile, The motion state of the mobiles such as pedestrian judges;And when there is traffic lights in target object, it can be to traffic signals The current color of lamp is judged, to obtain traffic lights signal condition indicated at present.
When user current location does not have blind way or traffic lights, can search in the information of storage, if having phase The location information of pass, and judge at a distance from user current location, if distance is less than some preset value, user can be guided Go to blind way, or from there is the crossing of traffic lights to pass through road.
Present embodiments provide a kind of method that wearable device guides blind person, the method which guides blind person By the location information of image information and user that acquisition camera currently acquires, the target object in image is identified, And from image or image and location information is combined to obtain target information, target information is converted into voice signal and passes through speech ciphering equipment Voice prompting is issued, and store-memory is carried out to information, to guide blind person.Information can be obtained by camera, And can be in conjunction with acquisition of information more information such as positioning, to solve in the related technology, blind person guides the information obtained single, And it is likely to require the defect for configuring special equipment, realize the function of being guided using camera blind person.
Second embodiment
Fig. 7 is a kind of flow chart for the method that the wearable device that second embodiment of the invention provides guides blind person.
In the present embodiment, setting wearable device opens the function of navigation, and on this basis, the present embodiment combines blind The method that the scene of people's navigation trip guides blind person to wearable device provided by the invention is further described.In this implementation In example, presetting the abnormal warning time such as network interruption is 30S, and prompt time that the road is clear is 10S, default to be able to carry out guidance Blind way distance is 500 meters.Refer to the flow chart shown in Fig. 7:
S701, navigation is opened
S702, it obtains the image that currently acquires of camera and identifies the target object in image
In the present embodiment, after opening navigation, camera is automatically opened, and enters the function of blind person's guide.
S703, user's current location information is obtained
It should be noted that obtaining the opportunity of user's current location information can be flexibly arranged, can start to navigate When just directly acquire;It can also be obtained while obtaining image information;It even can be to the target object in image It after acquisition, is first obtained, is obtained according to a part of target information of semantic object extraction, then the location information current to user To after location information, subsequent target information is obtained in conjunction with image, this mode can accelerate the speed of the response to image information Degree, enables users to be fed back faster.
S704, target information is obtained
In the present embodiment, user has had been switched on navigation, therefore can obtain target letter in conjunction with image and location information Breath.
Wearable device is while issuing conventional navigation routine information, the obstacle in the front that can also capture to camera Object, pit-hole, the target information of the target objects such as object of movement are obtained.It, also can be quasi- using simple image analysis technology The case where true acquisition traffic lights, can guide blind safety by there is the crossing of traffic lights.
S705, voice prompting and store-memory are issued
During navigation, real-time voice prompt should be constantly carried out, if in addition to target object phase in target information Other than the position of user, position there are also the geographical location of target object or target object relative to other objects can be with The prompting in geographical location or the position relative to other objects is not issued, and only the position to target object relative to user carries out Voice prompting;It should be understood that in store-memory, can also only to any one or more of target information information into Row store-memory.
If continuous 10S potentially affects current target object without discovery, issues the voice that the road is clear and mention Show information, guarantee that user is timely fed back, promotes experience.And when wearable device has occurred in network in the process Disconnected or other abnormal conditions can not obtain target information be more than 30S all without restoring normal when, issue abnormal phonetic warning and believe Breath guarantees that user will not take for that the road is clear because of no prompt, correspondingly, also right when wearable device restores normal User, which issues, restores normal prompt information.
S706, when having blind way within a predetermined range, blind person is guided to go to
During navigation, the target object that was once stored by the current location information of user and wearable device Current preset of location information judgement within the scope of whether there is this target object of blind way.In the present embodiment, if 500 There are blind ways within the scope of rice, then can issue voice prompting to blind person, inform the rough location information of blind way, and can repair Change navigation routine to guide blind person to the position of blind way.
It is understood that for facilities such as traffic lights, pavements, wearable device can also by location information into Row store-memory, and guide blind person to go to when in need.
S707, continue navigation until arriving at the destination
Newest image information is constantly obtained, real-time voice prompting is carried out to blind person during navigation, is helped Blind safety arrives at the destination.
It should be understood that can also information be integrated and be screened during this method is implemented, so that prompt Information more simplify accurately;And the priority of target information can be set, for it is important, may influence blind person go on a journey peace Full target information carries out preferential prompt.
The present embodiment image current by acquisition camera, identifies the target object in image, current in conjunction with user Location information obtains target information, and target information issues user by voice and prompts, so that user is during navigation The case where understand that at one's side, and blind way or traffic lights that once store-memory was crossed can be found,
3rd embodiment
The present embodiment gives a kind of application note of indoor guide scene, refers to Fig. 8, and Fig. 8 is that third of the present invention is real A kind of flow chart of the method for the wearable device guide blind person of example offer is provided.
In the present embodiment, wearable device is a kind of wrist machine, which is obtained by the camera of setting on the body Image data.
S801, it obtains the image that currently acquires of camera and identifies the target object in image
S802, the current location information of user is obtained
Wrist machine can obtain the positioning being presently in by means such as network, GPS.
S803, judge that user is currently at interior
After getting image and location information, wrist machine can easily be carried out the scene that user is presently in One judgement;And the position for the indoor scene that user usually stops, such as family or job site can be stored in wrist machine, At this point, can more accurately be judged in conjunction with image and location information.
S804, target information is obtained
When judgement discovery user is in indoor, the acquisition of target information can also be adjusted correspondingly, and more be obtained Take location information of the target object relative to the location information or target object of user relative to other objects, and target object Geographical location information can be without obtaining.
S805, voice prompting and store-memory are issued
The object that will be put in room can be laid particular emphasis in the case where indoors carries out store-memory as target object, and The frequent degree that voice prompting issues can also make certain downward.
It should be noted that in another embodiment specific implementation mode, indoors when, can be to target object relative to user Position carry out store-memory, and combine the gyroscope that configures in wrist machine, calculate the rough direction of motion of blind person and distance, i.e., So that target object is disappeared from the image that camera acquires, can also finally be obtained by operation after blind person walks about, target object Approximate location relative to blind person.
If S806, the searching instruction for receiving target object, issue voice prompting according to the position of store-memory
When blind person issues the instruction of searching target object, such as blind person's sending phonetic order " where is scissors ", wrist machine can To issue voice prompting " scissors is on kitchen countertop " according to the position of store-memory, also, work as user close to kitchen countertop wrist When recognizing this target object of scissors in machine camera, the voice prompting of more accurate position is issued to user.
It should be noted that in the present embodiment, target object can be prompted relative to the position of other objects, it can also be with Prompt target object is prompted relative to the position of user or the information of both combinations.In embodiment, the name in indoor each room Title and position feature can be configured by user, and auxiliary wrist machine carries out learning and memory to indoor environment, and can will be indoor The furniture etc. that change in location is less likely to occur is set as object of reference.
It should be appreciated that when wrist equipment is for gyroscope, it can also be to the target object phase to disappear from camera image The position of user is prompted, the current general orientation and distance of target object can be obtained by operation;Such as with Family has just used scissors and has placed on the table, turns round a distance of having walked about, gyroscope can calculate the angle that user turns round With the acceleration of walking, to obtain direction and rough distance of the scissors currently behind user, if user issues at this time The instruction for finding scissors can issue voice prompting according to the result of calculating.
Fourth embodiment
The present embodiment additionally provides a kind of wearable device, it is shown in Figure 9 including processor 91, memory 92, Communication bus 93, camera 94, in which:
Communication bus 93 is for realizing the connection communication between processor 91 and memory 92;
Computer code is stored in memory 92;
Processor 91 calls the computer code stored in memory 92 with the wearable device in above-mentioned first embodiment Guide each step of the method for blind person.
The present embodiment additionally provides a kind of computer readable storage medium, computer-readable recording medium storage have one or Multiple programs, one or more programs can be executed by one or more processor, to realize above-mentioned first embodiment or Wearable device guides each step of the method for blind person in two embodiments.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art The part contributed out can be embodied in the form of software products, which is stored in a storage medium In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal (can be mobile phone, computer, service Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much Form, all of these belong to the protection of the present invention.

Claims (10)

1. a kind of method that wearable device guides blind person, the wearable device includes camera, which is characterized in that including with Lower step:
It obtains the image that camera currently acquires and identifies the target object in described image;
Obtain the current location information of user;
Target information is obtained from described image or obtains the target information in conjunction with described image and the location information;
The target information includes at least one of the following: the base of the location information of the target object, the target object This information;
The location information of the target object includes at least one of the following: the geographical location of the target object, the mesh Mark position, target object position relative to other objects of the object relative to user;
According to the target information, voice prompting is issued, and store-memory is carried out to the location information.
2. the method that wearable device as described in claim 1 guides blind person, which is characterized in that described to be obtained from described image The target information is taken to include:
At least one of following information is obtained according to described image: position of the target object relative to user, the mesh Object is marked relative to the position of other objects, the essential information of the target object;
The combination described image and the location information obtain the target information
The geographical location of the target object is obtained in conjunction with described image and the location information.
3. the method that wearable device as claimed in claim 2 guides blind person, which is characterized in that the combination described image and The geographical location that the location information obtains the target object includes:
Position according to the current location information of the user and the target object relative to user, calculates the target The geographical location of object.
4. the method that wearable device as described in claim 1 guides blind person, which is characterized in that the wearable device is to institute Stating location information progress store-memory includes:
When the geographical location and the target object for including the target object in the target information are relative to other objects When at least one in position, the wearable device is to the target object and the target object relative to other objects At least one of position carries out store-memory.
5. the method that wearable device as claimed in claim 4 guides blind person, which is characterized in that the wearable device guides The method of blind person further include:
Whether detection user issues the instruction of the searching to the target object;
If user issues the searching to the target object and instructs, according to the mesh of store-memory in the wearable device The location information for marking object sends voice prompting.
6. the method that wearable device as described in any one in claim 1-5 guides blind person, which is characterized in that can described in detection Whether wearable device opens navigation feature;
If detecting, the wearable device opens navigation feature, and the transmission time interval of the voice prompting is less than the first threshold Value;
In first threshold time interval after the voice prompting transmission, without described in the described image that the camera obtains Target object then sends the speech prompt information that the road is clear;
If the network turn-off time of the wearable device is greater than second threshold, the speech prompt information of network interruption is sent.
7. the method that wearable device as claimed in claim 6 guides blind person, which is characterized in that the target object includes: Barrier, pit-hole, traffic lights, automobile, pedestrian, the essential information of the target object include: the big of the target object It is small;
When the target object is automobile or pedestrian, the essential information of the target object further include: the target object Motion state;
When the target object is traffic lights, the essential information of the target object further include: the traffic lights Signal condition.
8. the method that wearable device as claimed in claim 7 guides blind person, which is characterized in that if detecting in described image When there is no blind way or traffic lights, then the location information of store-memory in the wearable device is retrieved, sentenced It whether there is the blind way or the traffic lights in the third threshold range of disconnected user current location, user works as if judging There are the blind way or the traffic lights in the third threshold range of front position, then send the blind way or traffic letter The position indicating information of signal lamp.
9. a kind of wearable device, the wearable device includes camera, which is characterized in that the wearable device includes:
Processor, memory, communication bus;
The communication bus connects the processor and the memory;
Computer program code is stored in the memory;
The processor calls the computer code stored in the memory can to realize that claim 1-8 is described in any item The method of wearable device guide blind person.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has and can handle The computer program run on device is realized when the computer program is executed by the processor such as any one of claim 1-8 The method that the wearable device guides blind person.
CN201910656864.1A 2019-07-19 2019-07-19 Method, wearable device and the storage medium of wearable device guide blind person Pending CN110496018A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910656864.1A CN110496018A (en) 2019-07-19 2019-07-19 Method, wearable device and the storage medium of wearable device guide blind person

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910656864.1A CN110496018A (en) 2019-07-19 2019-07-19 Method, wearable device and the storage medium of wearable device guide blind person

Publications (1)

Publication Number Publication Date
CN110496018A true CN110496018A (en) 2019-11-26

Family

ID=68586405

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910656864.1A Pending CN110496018A (en) 2019-07-19 2019-07-19 Method, wearable device and the storage medium of wearable device guide blind person

Country Status (1)

Country Link
CN (1) CN110496018A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111081068A (en) * 2019-12-27 2020-04-28 歌尔股份有限公司 Wearable device and obstacle avoidance method and system
CN111449841A (en) * 2020-04-02 2020-07-28 上海海洋大学 A voice prompt simulation device for obstacles under prosthetic vision
CN111529324A (en) * 2020-05-07 2020-08-14 重庆工程学院 Blind guide instrument based on computer vision
CN111932866A (en) * 2020-08-11 2020-11-13 中国科学技术大学先进技术研究院 Wearable blind person outdoor traffic information sensing equipment
CN113350132A (en) * 2021-06-17 2021-09-07 山东新一代信息产业技术研究院有限公司 Novel blind-guiding watch integrating artificial intelligence and using method thereof
CN113679576A (en) * 2021-08-16 2021-11-23 深圳华昭科技有限公司 Bracelet obstacle avoidance navigation system and method for assisting blind person in going out
CN113892920A (en) * 2020-07-06 2022-01-07 华为技术有限公司 Wearable device wearing detection method and device and electronic device
CN115240404A (en) * 2022-09-19 2022-10-25 腾讯科技(深圳)有限公司 Vibration encoding method, vibration processing method, apparatus, device, and medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101986673A (en) * 2010-09-03 2011-03-16 浙江大学 Intelligent mobile phone blind-guiding device and blind-guiding method
CN105030491A (en) * 2015-07-17 2015-11-11 上海斐讯数据通信技术有限公司 Blind guide method and blind guide system
CN105167967A (en) * 2015-09-14 2015-12-23 深圳市冠旭电子有限公司 Blind guiding method and system
US9517175B1 (en) * 2013-03-14 2016-12-13 Toyota Jidosha Kabushiki Kaisha Tactile belt system for providing navigation guidance
CN107007437A (en) * 2017-03-31 2017-08-04 北京邮电大学 Interactive blind person's householder method and equipment
CN107328424A (en) * 2017-07-12 2017-11-07 三星电子(中国)研发中心 Air navigation aid and device
CN107802468A (en) * 2017-11-14 2018-03-16 石化盈科信息技术有限责任公司 Blind-guiding method and blind guiding system
CN109044754A (en) * 2018-06-29 2018-12-21 合肥东恒锐电子科技有限公司 A kind of intelligent blind men navigation method and system
WO2019087186A1 (en) * 2017-10-31 2019-05-09 Eran Schenker Systems and methods for detecting and monitoring hazardous obstacles

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101986673A (en) * 2010-09-03 2011-03-16 浙江大学 Intelligent mobile phone blind-guiding device and blind-guiding method
US9517175B1 (en) * 2013-03-14 2016-12-13 Toyota Jidosha Kabushiki Kaisha Tactile belt system for providing navigation guidance
CN105030491A (en) * 2015-07-17 2015-11-11 上海斐讯数据通信技术有限公司 Blind guide method and blind guide system
CN105167967A (en) * 2015-09-14 2015-12-23 深圳市冠旭电子有限公司 Blind guiding method and system
CN107007437A (en) * 2017-03-31 2017-08-04 北京邮电大学 Interactive blind person's householder method and equipment
CN107328424A (en) * 2017-07-12 2017-11-07 三星电子(中国)研发中心 Air navigation aid and device
WO2019087186A1 (en) * 2017-10-31 2019-05-09 Eran Schenker Systems and methods for detecting and monitoring hazardous obstacles
CN107802468A (en) * 2017-11-14 2018-03-16 石化盈科信息技术有限责任公司 Blind-guiding method and blind guiding system
CN109044754A (en) * 2018-06-29 2018-12-21 合肥东恒锐电子科技有限公司 A kind of intelligent blind men navigation method and system

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111081068A (en) * 2019-12-27 2020-04-28 歌尔股份有限公司 Wearable device and obstacle avoidance method and system
CN111449841A (en) * 2020-04-02 2020-07-28 上海海洋大学 A voice prompt simulation device for obstacles under prosthetic vision
CN111529324A (en) * 2020-05-07 2020-08-14 重庆工程学院 Blind guide instrument based on computer vision
CN113892920A (en) * 2020-07-06 2022-01-07 华为技术有限公司 Wearable device wearing detection method and device and electronic device
CN111932866A (en) * 2020-08-11 2020-11-13 中国科学技术大学先进技术研究院 Wearable blind person outdoor traffic information sensing equipment
CN113350132A (en) * 2021-06-17 2021-09-07 山东新一代信息产业技术研究院有限公司 Novel blind-guiding watch integrating artificial intelligence and using method thereof
CN113679576A (en) * 2021-08-16 2021-11-23 深圳华昭科技有限公司 Bracelet obstacle avoidance navigation system and method for assisting blind person in going out
CN115240404A (en) * 2022-09-19 2022-10-25 腾讯科技(深圳)有限公司 Vibration encoding method, vibration processing method, apparatus, device, and medium

Similar Documents

Publication Publication Date Title
CN110496018A (en) Method, wearable device and the storage medium of wearable device guide blind person
CN110109539A (en) A kind of gestural control method, wearable device and computer readable storage medium
CN110087292A (en) Intelligent wearable device, energy-saving control method and computer readable storage medium
CN109947327A (en) A kind of interface inspection method, wearable device and computer readable storage medium
CN110362369A (en) Wearable device control method, wearable device and computer readable storage medium
CN110308883A (en) Method for splitting, wearable device and the computer readable storage medium of screen
CN110211402A (en) Wearable device road conditions based reminding method, wearable device and storage medium
CN110069132A (en) Application control method, intelligent wearable device and computer readable storage medium
CN110401434A (en) Wearable device control method, wearable device and computer readable storage medium
CN110442295A (en) Wearable device control method, wearable device and computer readable storage medium
CN110175008A (en) Method, wearable device and the computer readable storage medium of operating terminal
CN110177209A (en) A kind of video parameter regulation method, equipment and computer readable storage medium
CN110069136A (en) A kind of wearing state recognition methods, equipment and computer readable storage medium
CN110098851A (en) A kind of sound control method, wearable device and computer readable storage medium
CN110069200A (en) Wearable device input control method, wearable device and storage medium
CN110109603A (en) A kind of page operation method, wearable device and computer readable storage medium
CN110174935A (en) Put out screen control method, terminal and computer readable storage medium
CN110209268A (en) Wearable device control method, wearable device and computer readable storage medium
CN110069102A (en) A kind of display area regulation method, equipment and computer readable storage medium
CN110213442A (en) Speech playing method, terminal and computer readable storage medium
CN109918014A (en) Page display method, wearable device and computer readable storage medium
CN109976869A (en) A kind of operation progress control method, equipment and computer readable storage medium
CN110083427A (en) A kind of application program interaction control method, equipment and computer readable storage medium
CN110162247A (en) A kind of screen control method, wearable device and computer readable storage medium
CN110491380A (en) Electricity-saving control method, intelligent terminal and the storage medium of intelligent terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191126