CN102641198B - Blind person environment sensing method based on wireless networks and sound positioning - Google Patents

Abstract

The invention discloses a blind person's environment perception method based on a wireless network and sound positioning, the implementation steps of which are as follows: 1) Arranging wireless tags with sounding functions in advance in each blind-guiding place in a blind-guiding place; 2) blind users Search and obtain the wireless tag list around the current position of the blind user through the handheld device with wireless access function, the handheld device outputs the wireless tag list to the blind user by voice, and jump to step 3) after the blind user selects a wireless tag, Otherwise, continue to step 2); 3) control the wireless tag selected by the blind user to emit a sound to assist the blind user to determine the location of the wireless tag. The invention allows the blind to perceive the surrounding environment information through voice, can help the blind to perform sound positioning on places of interest or room entrances, and provides convenience for blind users to travel.

Description

Environment perception method for blind people based on wireless network and sound localization

technical field

The invention relates to the field of guidance for the blind, in particular to an environment perception method for the blind based on a wireless network and sound positioning.

Background technique

In daily life, blind people need to rely on blind guide equipment to assist them when walking alone. Among them, the most common device is a cane, which can be used to judge whether there are obstacles ahead by tapping the cane in front. In order to allow the blind to live better independently, various electronic blind guide devices have appeared on the market, among which common ones include hand-held or other hand-held devices with a blind-guiding function. Such devices are usually based on various sensing technologies to detect obstacles around the blind person, thereby assisting the blind person to walk. The disadvantage of this type of equipment is that the information that can be obtained is limited. Generally, it can only detect obstacles around the blind person and give prompts, but cannot help the blind person perceive the surrounding environment, such as where the user is, what places and rooms are around. In recent years, a few auxiliary methods of environmental awareness have appeared, which can perceive and give voice feedback to the surrounding environment of blind users. Since such methods can generally perceive objects within a range of more than ten meters to tens of meters around the user, only based on voice feedback However, it is still difficult for blind people to determine the specific locations of these objects (such as the entrance to a room), and at this time blind users need further assistance and support.

Contents of the invention

The technical problem to be solved by the present invention is to provide a wireless network and sound positioning system that allows blind people to perceive the surrounding environmental information through voice, helps blind people to locate places of interest or room entrances, and provides convenience for blind users to travel. Methods of environmental perception for the blind.

In order to solve the problems of the technologies described above, the technical solution adopted in the present invention is:

A blind environment perception method based on wireless network and sound positioning, its implementation steps are as follows:

1) Pre-arrange wireless tags with sounding functions at each position where blind guidance is required in the blind guidance place;

2) The blind user searches and obtains the wireless tag list around the blind user's current location through a handheld device with wireless access function, and the handheld device outputs the wireless tag list to the blind user through voice, and jumps to execute when the blind user selects a wireless tag Step 3), otherwise proceed to step 2);

3) Control the wireless tag selected by the blind user to make a sound to assist the blind user to determine the location of the wireless tag.

As a further improvement of the above-mentioned technical scheme of the present invention:

The detailed steps of described step 3) are as follows:

3.1) Pre-store the wireless network tag information to the tag information server, and the handheld device locally establishes a wireless tag library for storing the wireless tag information;

3.2) When a blind user selects a wireless tag, the handheld device first identifies the wireless tag selected by the user through the locally stored wireless tag library, and if the identification fails, it accesses the tag information server to obtain the corresponding wireless tag information; if the identification succeeds Then read the wireless tag information stored in the wireless tag library by the wireless tag selected by the user;

3.3) The handheld device first judges whether the wireless tag information includes an audio file, and if the audio file is included, the audio file is directly played and output; if the audio file is not included, the handheld device converts the wireless tag information into The audio file is stored in the wireless tag library, and then the audio file is played and output;

3.4) The handheld device controls the wireless tag selected by the user to emit sound to navigate the location of the wireless tag.

The wireless tag has the sounding function of various prompt tones.

The detailed steps of described step 3.4) are as follows:

3.4.1) The handheld device sends control commands;

3.4.2) Analyze the type of prompt sound used in the control command. If the control command is to use the built-in prompt sound of the wireless tag, then randomly select a prompt sound as the audio to be output. If the control command is to use the prompt sound sent by the handheld device, the wireless The tag receives the audio file sent from the handheld device as the audio to be output;

3.4.3) Analyze the sounding mode of the prompt tone in the control command, if the sounding mode is one sounding, then exit after playing and outputting the audio to be output once; if the sounding mode is automatic sounding, then play and output the audio to be outputted Exit after number of times.

The detailed steps of playing and outputting the audio to be output when the sounding mode in the step 3.4.3) is automatic sounding are as follows:

3.4.3.1) The wireless tag detects the connection signal strength between handheld devices;

3.4.3.2) The wireless tag judges the distance between the wireless tag and the handheld device according to the connection signal strength;

3.4.3.3) Set the playing time interval and playing volume according to the distance, and then play and output the audio to be output according to the playing time interval and playing volume.

The present invention has the following advantages: the present invention uses wireless network tags to identify different places or rooms, blind users use wireless handheld devices to search for surrounding wireless network tags, and the handheld devices feed back the surrounding places or room information to blind people through voice, blind people can The voice positioning command is sent to the tag through the handheld device, and the tag will make a sound according to a predetermined pattern after receiving the command, and assist the blind user to determine the location of the tag. The invention comprehensively utilizes embedded computing, wireless network and sound positioning technology to assist the blind to obtain the surrounding environment Information can not only provide the surrounding places or room information in the form of voice, but also give its accurate location information through voice, which can solve the problem of travel difficulties for the blind to a certain extent, and let the blind perceive the surrounding environmental information through voice, which can help The sound positioning of places of interest or room entrances by blind people can facilitate the travel of blind users.

Description of drawings

Fig. 1 is a schematic diagram of the basic flow of the embodiment of the present invention.

FIG. 2 is a schematic diagram of an application structure of an embodiment of the present invention.

FIG. 3 is a schematic diagram of a workflow of a wireless tag according to an embodiment of the present invention.

Fig. 4 is a schematic diagram of the workflow of the tag information server according to the embodiment of the present invention.

Fig. 5 is a schematic diagram of the workflow of the handheld device according to the embodiment of the present invention.

Detailed ways

As shown in Figure 1, the implementation steps of the blind person's environment perception method based on wireless network and sound positioning in this embodiment are as follows:

1) Pre-arrange wireless tags with sounding functions at each position where blind guidance is required in the blind guidance place;

2) The blind user searches and obtains the list of wireless tags around the current location of the blind user through a handheld device with wireless access function. The handheld device outputs the list of wireless tags to the blind user through voice. When the blind user selects a wireless tag, jump to step 3 ), otherwise continue to step 2);

3) Control the wireless tag selected by the blind user to make a sound to assist the blind user to determine the location of the wireless tag.

The detailed steps of step 3) are as follows:

3.1) The wireless network tag information is stored in the tag information server in advance, and the handheld device locally establishes a wireless tag library for storing wireless tag information;

3.2) When a blind user selects a wireless tag, the handheld device first identifies the wireless tag selected by the user through the locally stored wireless tag library. If the identification fails, it will access the tag information server to obtain the corresponding wireless tag information; if the identification is successful, it will read Get the wireless tag information stored in the wireless tag library of the wireless tag selected by the user;

3.3) The handheld device first judges whether the wireless tag information contains an audio file, and if it contains an audio file, it will directly play and output the audio file; if it does not contain an audio file, the handheld device converts the wireless tag information into an audio file through a text-to-speech conversion engine and stores it in Wireless tag library, and then play and output the audio file;

3.4) The handheld device controls the wireless tag selected by the user to emit sound to guide the location of the wireless tag.

The wireless tag has the sounding function of various prompt tones.

The detailed steps of step 3.4) are as follows:

3.4.1) The handheld device sends control commands;

3.4.2) Analyze the type of prompt sound used in the control command. If the control command is to use the built-in prompt sound of the wireless tag, then randomly select a prompt sound as the audio to be output. If the control command is to use the prompt sound sent by the handheld device, the wireless The tag receives the audio file sent from the handheld device as the audio to be output;

3.4.3) Analyze the prompt tone sounding mode in the control command. If the sounding mode is one sound, it will exit after the output audio is played and output once; if the sound mode is automatic sounding, it will exit after the output audio is played and output for a preset number of times.

Step 3.4.3) When the sound mode is automatic sound, the detailed steps of playing and outputting the audio to be output are as follows:

3.4.3.1) The wireless tag detects the connection signal strength between handheld devices;

3.4.3.2) The wireless tag judges the distance between the wireless tag and the handheld device according to the connection signal strength;

3.4.3.3) Set the playback time interval and playback volume according to the distance, and then play and output the audio to be output according to the playback time interval and playback volume.

As shown in FIG. 2 , this embodiment involves three types of devices: wireless tags, tag information servers, and handheld devices.

Wireless tags can be implemented using wireless network technologies such as Wi-Fi, Bluetooth, and ZigBee, and are installed at the entrance of places or rooms to mark unused places and rooms. The tag has a sound function. When receiving commands from the handheld device, the tag will emit a prompt sound to help blind users judge the location of the place or room marked by the tag. There are two ways to play the prompt tone of the wireless tag: 1) The wireless tag comes with it. The wireless tag itself stores a variety of different prompt tones. In order to avoid interference caused by simultaneous use by multiple users, the handheld device will generate a random number. When the tag receives a command from the handheld device, the tag will play the corresponding sound according to the random number in the command. beep. 2) User-defined. The user can set a custom prompt sound on the handheld device. When the handheld device sends a sound positioning command to the tag, the audio file corresponding to the custom prompt sound is transmitted to the wireless tag, and the wireless tag plays the received audio file. There are two modes of voice prompts: 1) User-controlled prompt mode. Every time the user sends a voice positioning command, the tag will send out a prompt sound, and the user can control the tag to send out a prompt sound as many times as required. 2) Label automatic prompt mode. The user only needs to send a command once, and the tag can estimate the physical distance between the two according to the detected wireless network signal strength of the handheld device, and automatically control the tag to emit a beep according to the distance. The smaller the distance, the shorter the interval between the beeps. The shorter, the lower the volume.

As shown in Figure 3, the working process of the wireless tag is as follows:

a1) Waiting for the handheld device to connect;

a2) Parse the command, if it is a user-defined prompt sound, the tag receives and stores the audio file sent by the handheld device;

a3) Analyzing the command, if the label has its own prompt tone, the label selects the prompt tone from the local audio according to the random number sent by the handheld device;

a4) Analyzing the command, if the sound mode is controlled by the user, the tag receives the command once and plays a prompt tone once;

a5) Analyzing the command, if it is the automatic sounding mode of the label, the label will play the prompt sound continuously;

a6) The tag utilizes the detected wireless network signal strength of the handheld device to estimate the physical distance from the tag;

a7) The label adjusts the volume and time interval of playing the prompt sound according to the distance estimation. The closer the distance, the lower the volume and the shorter the time interval. .

The label information server centrally stores the MAC address of the label and its corresponding place or room information. Only using handheld devices, the local tag information database generally only stores the environmental information of the user's frequent activity area. When the blind user arrives in an unfamiliar area, the blind user cannot perceive the new environment around him. The label information server centrally stores the MAC address of the label and the corresponding place or room information. Each user can upload his own label information to the server label information database, share it with other users, and download the label information shared by other users. Users can jointly manage and maintain the label information library on this platform. This greatly enriches the amount of user tag information, enabling users to effectively perceive the surrounding environmental information in unfamiliar areas.

As shown in Figure 4, the workflow of the tag information server is as follows:

b1) Accept user login;

b2) The server judges the login user name and password to determine whether they are correct;

b3) The login fails, indicating that the user name or password is wrong, and the user can choose to register a new user at this time;

b4) When registering, first judge whether the user name already exists, and return to register if it already exists;

b5) After successful login, the server waits for the request from the handheld device;

b6) If the handheld device requests to upload tag information, it accepts the uploaded information and saves the information in the tag information library of the server;

b7) If the handheld device sends an unknown tag list requesting the server to match, the server receives the list;

b8) The server compares the addresses in the list with the addresses stored on the server tag information database one by one to determine whether there is an identifiable tag;

b9) If a tag address is not recognized, the server does not process it;

b10) If the information of a tag address is stored on the server, the server transmits the information back to the handheld device for processing.

The handheld device adopts the same wireless network technology as the tag, and is carried by blind users to discover the surrounding wireless tags, give voice prompts to tag information and send voice positioning commands. The handheld device discovers the surrounding wireless tags through the wireless network; obtains the location or room information corresponding to the tag from the local or tag information server; feedbacks the information to the blind user through voice; the blind user can send a voice positioning command to the tag through the handheld device; the tag After receiving the command, it will make sound according to the predetermined pattern, and assist the blind user to determine the entrance position of the place or room. Handheld devices are carried by blind users and use the same wireless networking technology as wireless tags. Its function is to search the surrounding wireless tags, obtain the tag address list, obtain the detailed information of the tags by querying the local tag information database or connect to the server through the mobile network, and feed back the tag information to the user through the speech synthesis engine. If a blind user is interested in a certain tag in the environment, he can also interact with the tag through a handheld device, and send a voice positioning command to control the tag to emit a prompt sound to assist the blind user to determine the location of the tag.

As shown in Figure 5, the workflow of the handheld device in this embodiment is as follows:

c1) After starting the search function, search the surrounding wireless tags circularly and obtain the tag address list;

c2) matching the address list with the addresses on the local label information base;

c3) If there is a matching item in the local label information base or the label information server, it is judged whether the label has been prompted in the previous search;

c4) If the label was not prompted in the last search, then utilize the speech synthesis engine to convert the label text information into a voice file;

c5) Call the audio module to play the recording or voice file corresponding to the tag to prompt the blind user;

c6) If the label has been prompted in the previous search, it will not be prompted this time to avoid repeated prompts;

c7) When there is a local unrecognized label, first determine whether the user has logged in to the label information server;

c8) Whether logged in or not, the user can choose to add new tag information on the handheld device. When adding information, users can choose to enter the label information in text or record audio for the label, so that the user can be prompted for the label in future searches;

c9) After the user adds tag information, he can choose to upload the tag information to the server. Considering the traffic problem, only the text description information will be uploaded to the server;

c10) If the user has logged into the tag information server, the local unrecognized tag address list is sent to the server for query;

c11) If the tag information is queried on the server tag information database, the server will send the tag-related information to the handheld device for processing, and the handheld device will save the information to the local tag information after receiving the tag information library, and prompt the user;

c12) If the user is interested in a tag in the prompt list, he can issue a command to the tag through the handheld device, and the tag side will analyze the command and send out a corresponding prompt sound to help locate the tag.

In this embodiment, wireless network tags are used to identify different places or rooms. Blind users use wireless handheld devices to search for surrounding wireless network tags. Voice positioning command, the tag will sound according to the predetermined mode after receiving the command, and assist the blind user to determine the location of the tag. The working steps are as follows: Step 1. After starting, you can choose to add tag information, that is, input the information of the tag to the local tag Stored in the information database, the information here includes the physical address of the tag, the place or room information corresponding to the tag, and the voice played after the tag is found, which can be recorded by the user through the recording module. Step 2, enter the search state, search the surrounding tags circularly, and get the list of surrounding tag addresses. Step 3: Match the surrounding tag address list with the address list in the local tag information base. If there is a match, call the audio module to play the voice stored in the address to prompt the user. Step 4. If there is no matching item, the handheld device can log in to the tag information server for further matching. If there is a matching item, the tag information will be sent back to the handheld device and stored in the local tag information database, and then the audio module will be called to play the corresponding tag information. voice. Step 5, if the blind user is interested in a tag in the searched tag list and wants to determine its specific location, he can select the tag in the list, and the handheld device will send a command to the tag through the wireless network. After receiving the command, The tag will sound according to a predetermined pattern, and blind users can find the location of the tag by following the sound.

The above descriptions are only preferred implementations of the present invention, and the scope of protection of the present invention is not limited to the above-mentioned implementations. All technical solutions belonging to the principle of the present invention belong to the scope of protection of the present invention. For those skilled in the art, some improvements and modifications made without departing from the principles of the present invention should also be regarded as the protection scope of the present invention.

Claims (2)

1. blind person's environment perception method based on wireless network and sound localization is characterized in that implementation step is as follows:

1) need the position of guide to arrange the wireless identification tag with vocal function respectively at each of guide place in advance;

2) blind users obtains the wireless identification tag tabulation on every side of blind users current location by the handheld device search with accessing wirelessly function, described handheld device is given blind users with the wireless identification tag tabulation by voice output, redirect execution in step 3 after blind users is selected a wireless identification tag), otherwise continue execution in step 2);

3) the selected wireless identification tag of the control blind users assisting blind user that sounds determines the position of wireless identification tag;

The detailed step of described step 3) is as follows:

3.1) in advance wireless tag information being stored to the label information server, described handheld device is set up the wireless identification tag storehouse that is used for the storage wireless tag information in this locality;

3.2) after blind users was selected a wireless identification tag, handheld device was at first identified the wireless identification tag that the user selectes by the wireless identification tag storehouse of this locality storage, if recognition failures then visit described label information server and obtain corresponding wireless tag information; If identify successfully then read the wireless tag information that wireless identification tag that the user selectes is stored in described wireless identification tag storehouse;

3.3) handheld device judges at first whether described wireless tag information comprises audio file, if comprise audio file then directly described audio file play output; If do not comprise audio file, then handheld device is converted to audio files storage to the wireless identification tag storehouse by the text voice transform engine with wireless tag information, then described audio file is play output;

3.4) the sound position of the described wireless identification tag of navigation of the wireless identification tag selected of handheld device control user;

Described step 3.4) detailed step is as follows:

3.4.1) the handheld device transmitting control commands;

3.4.2) use the type of prompt tone in the analysis and Control order, if control command is for using the built-in prompt tone of wireless identification tag then select a kind of prompt tone as treating output audio at random, if control command is for the prompt tone that uses handheld device and send then wireless identification tag receives the audio file that sends from handheld device as treating output audio;

3.4.3) prompt tone sounding pattern in the analysis and Control order, if the sounding pattern is a sounding then described treating is withdrawed from after output audio is play output once; If the sounding pattern is automatic sounding then described treating is withdrawed from after output audio is play the output preset times.

2. the blind person's environment perception method based on wireless network and sound localization according to claim 1 is characterized in that described step 3.4.3) in the sounding pattern will to treat that output audio is play the detailed step of output when being automatic sounding as follows:

3.4.3.1) wireless identification tag detects the connection signal intensity between the handheld device;

3.4.3.2) wireless identification tag judges distance between wireless identification tag and the handheld device according to connecting signal intensity;

3.4.3.3) reproduction time is set at interval and broadcast sound volume according to described distance, according to described reproduction time interval and broadcast sound volume the described output audio for the treatment of is play output then.

Images