US9668041B2

US9668041B2 - Activity monitoring and directing system

Info

Publication number: US9668041B2
Application number: US13/999,759
Authority: US
Inventors: Jon L. Vavrus; Stig M. Pedersen; Lawrence Weill
Original assignee: ZONAAR CORP
Current assignee: ZONAAR CORP
Priority date: 2013-05-22
Filing date: 2014-03-18
Publication date: 2017-05-30
Also published as: US20140348367A1

Abstract

A system for monitoring and directing athletic or other physical activities is disclosed. In one embodiment of the invention, a headset worn by an athlete includes one or more sensors, a microprocessor, a non-volatile memory and a communication link. The athlete's headset receives and transmits signals to a coach while the athlete is performing an activity. In this embodiment, the present invention provides coordinated audio streams to the athlete during his/her activity and training.

Description

CROSS-REFERENCE TO RELATED A PENDING PATENT APPLICATION & CLAIM FOR PRIORITY

The Present Non-Provisional patent application is based on Pending Provisional U.S. Patent Application No. 61/855,725, filed on 22 May 2013.

In accordance with the provisions of Sections 119 and/or 120 of Title 35 of the United States Code of Laws, the Inventors claim the benefit of priority for any and all subject matter which is commonly disclosed in the Present Non-Provisional patent application, and in the Provisional Patent Application U.S. Ser. No. 61/855,725.

FIELD OF THE INVENTION

One embodiment of the present invention comprises a wireless telecommunication system for providing multiple streams of content to a receiver. In one particular embodiment of the invention, a headset worn by an athlete includes one or more sensors, a microprocessor, a non-volatile memory, a radio and an ultrasonic communicator. The athlete's headset receives and transmits signals to a coach while the athlete is performing.

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

None.

BACKGROUND OF THE INVENTION

The number of wireless telecommunication devices that are currently available for use by athletes is relatively small. Athletes may currently used cellular or smart phones for two-way communications, or may use MP-3 players to listen to audio content. No device is presently on the market that provides athletes with a transceiver device that enables the delivery of multiple streams of content. No device is presently on the market that also combines a multiple-stream of content transceiver with sensors that provide information about the athlete. No device is currently on the market that allows real-time communication through water to an athlete without impeding their performance.

The development of a system that would constitute a major technological advance, and would satisfy long-felt needs in the athletic equipment business.

SUMMARY OF THE INVENTION

One embodiment of the present invention comprises a wireless telecommunication system for providing multiple streams of content to a receiver. In one embodiment of the invention, a headset worn by an athlete includes one or more sensors, a microprocessor, a non-volatile memory, a radio and an ultrasonic underwater communication device. In this embodiment, the headset is a remote transceiver which receives and transmits signals to a coach via a standard computer, a laptop, a tablet, a smart phone or via some other suitable personal computing device or information appliance.

In this embodiment, the present invention provides coordinated audio streams to an athlete during his/her exercise and training, while logging sensor output for evaluation in real time (by the coach) or post-exercise. In one implementation, the system coordinates audio for entertainment (such as music), real time performance information (such as count of laps, heart rate, etc.), possible activity instructions and interrupt audio such as a coach's advice, or cell phone messages. Alternative embodiments may be used for any exercise/sport that involves long or repetitive periods of activity; such as running, walking, general exercise, etc. In addition, the invention, the invention may be used for medical rehabilitation, physical therapy or any other applications which require monitoring body positions and assisting, guiding or otherwise communicating with a patient.

An appreciation of the other aims and objectives of the present invention, and a more complete and comprehensive understanding of this invention, may be obtained by studying the following description of a preferred embodiment, and by referring to the accompanying drawings.

A BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a swimmer in a pool who is being monitored by a coach. The swimmer wears a headset that enables him or her to receive multiple wireless streams of content from a system communication module near the pool.

FIG. 2 is a close-up view of the swimmer in the water.

FIG. 3 shows a bicyclist wearing a headset which communicates with the coach through the system communication module.

FIG. 4 provides a schematic block diagram of circuitry that is included in one embodiment of the headset.

FIG. 5 supplies a schematic diagram which shows the system communication module providing links to multiple users.

FIG. 6 presents a more detailed schematic block diagram of the system communication module, as well as a schematic block diagram of the athlete's device.

FIG. 7 shows how a the system communication module provides wireless links to an iPhone or computer and/or a swimmer's device.

FIG. 8 shows the addition of performance sensors to the system shown in FIG. 7.

FIGS. 9 and 10 supply additional views of the wireless network created by the system communication module.

FIG. 11 is a flowchart that illustrates one embodiment of the present invention.

FIG. 12 portrays the spectrum that is used for wireless multi-stream communications in one particular embodiment of the invention.

FIG. 13 supplies a schematic view of the radio circuitry that may be utilized in one embodiment of the invention.

FIG. 14 illustrates frequencies that may be used for wireless communications for the present invention.

FIGS. 15 and 16 offer additional schematic views of circuit components that may be used to implement one embodiment of the invention.

FIGS. 17 and 18 reveal frequency allocations that may be used to implement one embodiment of the invention.

FIG. 19 is a schematic diagram of circuitry that may be employed for wireless communications for one embodiment of the invention.

FIGS. 20, 21 and 22 illustrate magnetic flux patterns that are generated by the swimmer's laps in a pool.

FIGS. 22, 23 and 24 offer representations of a Cartesian Coordinate System that serves as a sensor frame; a depiction of gravity and magnetic flux vectors during a forward lap, and a depiction of gravity and magnetic flux vectors during a reverse lap.

A DETAILED DESCRIPTION OF PREFERRED & ALTERNATIVE EMBODIMENTS

Section One: Overview of the Invention

FIG. 1 depicts a generalized view 10 of one embodiment of the invention. A swimmer 12 wearing a remote transceiver or headset 14 communicates over a wireless link 15 with a system communication module 16, which operates nearby the pool. A coach 18 using a smart phone 20 also communicates over a wireless link 15 through the system communication module 16. The wireless link 15 may be a radio frequency signal that is propagated through the air, and/or an ultrasonic link that is transmitted through water. In alternative embodiments of the invention, the wearer of the headset 14 may be a person engaged in a wide variety of athletic activities in any number of sports environments. In this Specification, and in the Claims that follow, the term “wireless link” is intended to encompass any transmission of data, information or content between or among a number of mobile transceivers. Specifically, the wireless link may be propagated as one or more Wi-Fi, WiMax, Bluetooth, cellular, radio frequency, ultrasonic signals, or any other suitable emanation that connects the user of the headset or device 14 with one or more other persons or terminals.

FIG. 2 offers an expanded view 21 of the swimmer 12 in the water. The headset 14 includes a processor 22 and a non-volatile memory 24. In this Specification, and in the Claims that follow, the term “headset” is a remote transceiver that is intended to encompass any device worn by or associated with an individual which is capable of transmitting or receiving wireless signals and producing audio which may be heard by the individual. The wireless signals may be sent to or received from a standard computer, a laptop, a tablet, a smart phone or some other suitable personal computing device or information appliance.

FIG. 3 provides a generalized view 26 of an athlete 12 on a bicycle 27. The headset 14 is connected to an athlete module 28 which sends and receives information over a wireless link 15 to the system communication module 16. The coach 18 uses his smart phone 20 to communicate to the system communication module 16 over another wireless link 15.

FIG. 4 presents a schematic block diagram 30 which illustrates the components of one particular embodiment of the circuitry that resides inside the headset 14. The headset 14 includes a transceiver 32 which is connected to an antenna 34 and a processor 36. The processor 36 is connected to a non-volatile memory 38, a power source 40, and one or more sensors 42. In this particular embodiment, the sensor package 42 includes three mutually orthogonal accelerometers and three magnetic sensors.

In alternative embodiments, the user may wear a different, but generally equivalent device that functions like the headset 14. As examples, the headset 14 could be configured so that it is clipped to a belt, or worn on an armband. In another embodiment, the headset may be configured so that its functions are physically separated into different modules such as: external battery, hear rate sensor on a chest belt, motion sensors on ankle and wrist, processor module on headband or helmet.

FIG. 5 portrays a schematic diagram 44 that shows that more than one user (Coach 18 and Coach 46) may communicate over different wireless links 15 with the system communication module 16 using

smart phones

20 and 48. In alternative embodiments, persons may communicate with the system communication module 16 using a variety of information appliances, including, but not limited to, tablets, personal computers, laptops, netbooks, radios or any other suitable device that is capable of wireless communication.

FIG. 6 reveals a view 50 of the circuitry within one embodiment of the system communication module 16. The system communication module 16 generates one or more streams of content, information or data which may include initial coach input, audio entertainment and/or coaching updates. The athlete's device 14 may transmit a number of different streams of information back to the system communication module 16, including, but not limited to, heart rate, speed, location, motion, altitude, incline, cadence and/or steps.

FIG. 7 depicts one configuration of the present invention. A smart phone, such as an iPhone™, transmits audio files over a wireless link 15 to the system communication module 16, which, in turn, relays the audio files over another wireless link 15 to the swimmer's device 14.

In FIG. 8, a coach 18 using an information appliance 20 transmits information over a wireless link 15 to the system communication module 16, which, in turn, conveys the information to the swimmer's headset 14 using an ultrasonic signal 58 that propagates through the water in the pool. Automated performance sensors are shown connected to the swimmer's transceiver 14.

FIGS. 9 and 10 reveal

additional configurations

58 and 60 of the present invention. In FIG. 9, a coach 18 with an information appliance 20 receives information over a wireless link 15 from the system communication module 16, which has received the information over another wireless link 15 from the swimmer's device 14. In FIG. 10, a coach 18 with an information appliance 20 transfers new audio data to the system communication module 16, and then on to the swimmer's device 14.

FIG. 11 presents a flow chart 62 that shows the method steps of one embodiment of the present invention, which coordinates the multiple audio streams that are delivered to the headset.

FIG. 12 is a spectrum 64 of transmitted signal strength 66 plotted against frequency 68. Four content streams or channels labeled A, B, C and D are shown along a frequency band that spans 100 to 250 KHz. FIG. 12 depicts a particular embodiment of an ultrasonic underwater communication system used for communication with a swimmer. Other embodiments may use other specific ultrasonic frequencies.

FIG. 13 is a schematic diagram 70 that illustrates the signal processing used to combine two ultrasonic communication links used simultaneously in the same swimming pool by two different coaches, as depicted in FIG. 5. Two separate swimmer selector tones 72 and 73 are produced by tone generators 74 and 75, and are then combined by a signal adder 76. The combined signal is then converted to a final frequency band through multiplication of a reference frequency 78. The resulting unspread signal 80 is passed to further processing (see FIG. 16, below).

FIG. 14 offers a graph 82 of the frequency components of only the swimmer select channel A of the composite ultrasonic signal. One of the frequencies is used for an announcement tone 84. The graph plots signal strength 83 versus frequency 86. At different points in the frequency band 86, the various select tones will be at their unique frequencies. One group of select tones from a first coach 88 will be separated from another group of select tones from a second coach 90.

FIG. 15 supplies three schematic diagrams that reveal how three different content channels are transmitted. A first coach 18 provides voice commands which are conveyed through amplifier 96, a Low Pass Filter 98 (3 kHz in this embodiment) and are modulated at a specific frequency (150 kHz in this embodiment) via modulator 100 to produce one unspread audio channel (B) 102. A second coach 46 provides voice commands which are conveyed through amplifier 106, a Low Pass Filter 108 (10 kHz in this embodiment) and are modulated at a specific frequency (200 kHz in this embodiment) via modulator 110 to produce one unspread audio channel (C) 112. Music and/or announcements 114 are conveyed through amplifier 116, a Low Pass Filter 118 (10 kHz in this embodiment) and are modulated at a specific frequency (250 kHz in this embodiment) via modulator 120 to produce one unspread audio channel (D) 121.

FIG. 16 portrays another schematic diagram 122 showing channels A, B, C and D 124, and the signal processing used to combine and transmit the signals from FIGS. 13 and 15. The input signals are summed by a signal adder 126, and then added to a pilot frequency (100 kHz in this embodiment) 128. The signal is then multiplied by a 30 kilochip/second pseudorandom number code 130 resulting in a spread spectrum signal. An optional, unspread pilot frequency signal (100 kHZ in this embodiment) 132 may be added to ease the process of signal tracking at the point of the signals receipt. The complete signal has its level increased through an amplifier 134, and is then transmitted into the water via a hydrophone 136.

FIG. 17 is a graph 138 of signal strength 140 plotted against frequency 142 of the complete unspread signal. The complete unspread signal would correspond to point 143 in FIG. 16. FIG. 18 is a graph 144 of signal strength 146 plotted against frequency 148 of the complete signal after spreading. The complete signal after spreading would correspond to point 149 in FIG. 16.

FIG. 19 is a schematic diagram 150 of the signal processing required at the swimmer's headset to decode the received ultrasonic signal. The signal is received by the swimmer's hydrophone 150-1 and amplified by amplifier 150-2A. The signal is then split, one part is sent into a tracking processor 150-3 which implements any of various, known, tracking loops to match the frequency of signals and the received PN code. One output of the tracking processor is a duplicate 150-2B of the 30 kilochip/second pseudorandom number code with which the signal was spread at the transmitter. This is used to despread the signal (transform the signal from spread spectrum to normal) through a despreader 150-4. The other outputs of the tracking processor are frequency tones that match the center frequency of each of the modulated signal channels A, B, C and D in the composite received signal. These are used to produce baseband signals for each of the four channels through appropriate frequency shifts on the composite signal 150-5, 150-8, 150-10, 150-12. After frequency shifting to baseband the resulting signals are passed through appropriate low pass filters and demodulation processes 150-6, 150-9, 150-11, 150-13. The swimmer select channel A signal is then passed through a tone decoder and channel selector 150-7 which produces signals 150-15 which are used to select one (or more) of the audio channels. After processing the signal through an AND gate, the selection signals with the different audio channels the final audio stream 150-14 is sent to the swimmer's earphones.

FIG. 20 supplies a schematic view 152 of the directions of magnetic flux relative to the forward and reverse 154 and 156 laps of the swimmer in the pool.

FIG. 21 presents another view 158 of the direction of magnetic flux relative to the forward progress of the swimmer for forward and reverse

laps

160 and 162.

FIGS. 22, 23 and 24 offer representations of a Cartesian Coordinate System 166 that serves as a sensor frame; a depiction of gravity and magnetic flux vectors during a forward lap 168, and a depiction of gravity and magnetic flux vectors during a reverse lap 170.

Section Two:

Operation of Preferred & Alternative Embodiments of the Invention
Headset & Sensors

One embodiment of the invention comprises a combination of hardware and software running that may include a system communication module 16, and a smart phone, tablet computer, personal computer or some other suitable information appliance 20. In one embodiment, a head set or other device 14 worn by a user 12 includes one or more real time performance sensors 42.

The present invention includes a combination of hardware and specially designed software that transforms the state of the device 14, and that produces information and communications capabilities that are not available to the user 12 without this combination of hardware and special purpose software.

The sensors 42 derive measurements of various performance metrics. The sensors 42 are worn on an athlete's body 12, and are linked by a wired or wireless connection 15 to the headset 14. The sensors 42 may include, but are not limited to:

Lap counter

Heart rate monitor

Respiration (breath rate) monitor

Stroke counter

Speedometer

Lap timer

The sensors 42 provide data in digital electronic form to the headset 14 during the athletic activity.

In one embodiment, the headset 14 comprises a processor 22 and a non-volatile memory 24. Additional memory may be connected to the headset 14 for supplying generally continuous entertainment audio, such as music files, playlist, books on tape, workouts, etc. The processor 22 is capable of driving a set of headphones 14A, such as ear buds, inductive bone system, etc., that would provide audio to the athlete 12.

In one embodiment, the headset 14 is equipped with wireless communication capabilities for receiving data from the System communication module. These capabilities may include, but are not limited to, Bluetooth, IEEE 802.11 (Wi-Fi) and/or some other suitable wireless system. Alternative embodiments may also include multiple communication capabilities. For a swimmer 12, this would include an out-of-water communication method based on radio transmissions (such as Wi-Fi), and an in-water communication method. An alternative embodiment that uses ultrasonic frequencies through water is described below.

In one embodiment, the athlete's headset 14 is configured to to translate the digital data received from the real time performance sensors 42 into understandable audio. This feature is accomplished using commercially available text-to-speech algorithms or pre-recorded voice. Some examples of this audio would be:

Finished lap

10

Heart rate

92

Last lap time was 20 seconds

3 seconds behind target pace

3 seconds behind John's most recent pace

System Communication Module

The system communication module 16 provides a communication link 15 to the headset 14 as well as to applications running on a smart phone or computer 20 (coach's software, audio download software). For a swimming application, this module 16 communicates with smart phones via Wi-Fi or Bluetooth and communicates with the headset 14 using Wi-Fi (out-of-water communication) or ultrasonic underwater frequencies (in-water communication).

The system communication module 16 includes all the hardware that is necessary to provide these communication capabilities, as well as a small computer system to handle two different modes of communication:

- First Mode: Before the athletic activity starts, the system communication module 16 transfers the entertainment audio stream files to the headset 14 via wireless (Wi-Fi) communication. It also transfers any activity instructions, e.g., “Change to backstroke on the next lap” that are required for the swimmer to the headset 14 over the same wireless link 15.
- Second Mode: During the activity, the system communication module 16 sends any interrupt audio message to the headset 14. Examples of these interrupt audio messages may include voice messages from the coach 18, such as:
- “You must pick up your pace,” or
- “That was good, but you′re too fast, you will burn yourself out before you finish,”
  These interrupt audio messages may also include information from the athlete's smart phone. The coach 18 is also able re-define or even define the workout during the activity.

During the activity, the system communication module 16 also receives data from the headset 14 when a communication link is available for such data transfer. This data comprises data accumulated from the sensors 42 by the headset 14. The system communication module stores and/or forwards this data to the coach 18.

In an alternative embodiment, the system communication module 16 provides the means for charging one or more headsets 14 when they are not being used. The headset charging is done inductively or through a wired connection.

Coach's Software

In one embodiment of the invention, the information appliance used by the coach runs a specially configured software application. This software application is used by a coach 18 in real-time as the athlete 12 is performing the activity. One of the functions of the software application is to provide the coach 18 with the ability to select an individual athlete to communicate with, and then to translate his/her voice to digital form and send it to the system communication module 16 for forwarding on to the particular athlete selected. The system will also have the ability to select subgroups (e.g., lanes) or all swimmers in the pool as recipients of an audio message.

Various other functions of this software include, but not be limited to, display of athletes picture, prior performance (in graphical or tabular form), the ability to add notes or voice memos to an athletes data profile, and/or receiving real-time performance information (lap count, speed).

After a given session, the software application uploads the performance results, coach's notes, and/or other information or data to a server. Such a server is connected to the internet (which may be referred to a “remote server” or “the cloud”), to a local network, or is a stand-alone computer. The server enables the sharing of data amongst teammates or others using the system (parents, friends, other athletes or coaches). The use of a server also allows coaches (or others) to define pre-packaged workouts (with or without music) for others to use, either as sellable content or as freeware.

Audio Download Software

A second software application that runs on a smart phone or computer is employed to send the entertainment audio data (in the form of computer files) to the system communication module 16 before the athletic activity starts, or during the athletic activity. The selection of what audio to send would be made through user choice either in real-time, or made at some previous time, e.g., at home, long before getting to the pool. The audio file is sent to the system communication module by the coach 18 or by the athlete 12, and the audio file can be sent to a specific headset 14, group of headsets or all headsets.

System Operational Modes

The present invention operates in two distinctive modes. The first mode, which includes two steps, is implemented prior to the beginning of the athletic activity beginning, as shown in FIG. 7.

Step One: Audio content is selected by the athlete, the coach, or a third party. The selection would be made through using the audio download software, and is done prior to the athlete getting to the pool (though it could also be done at poolside on a smart phone/tablet).

Step Two: The audio download software then communicates with the system communication module 1 and transfers the audio files, playing instructions and/or athletic activity instruction audio files through the module 16 and into the headset 14. This transfer can be either a point to point transmission (or series of point to point transmissions), targeted at an individual swimmer, or a point to multi-point transmission, in which one set of audio files are downloaded for all the swimmers on a given day. The system communication module 16 then duplicates the data, and downloads it to each headset 14. This download takes place before the athletic activity, and, as an alternative, before the swimmer actually gets into the pool. This process need not be simultaneous for each headset 14. The system communication module 16 coordinates the transmission of data to each headset as it becomes available.

The second mode, which includes five steps, is implemented during the athletic activity, as shown in FIG. 8.

Step One. As the athlete 12 performs the activity, the headset 14 plays the entertainment audio stream generally continuously, which allows, for example, the swimmer to hear music while swimming his/her laps.

Step Two. At regular intervals, or when certain events occur (like finishing a lap), the headset 14 will transform some or all of the digital data received from the real time performance sensors 42, and then delivers it in audio form to the athlete 12. For example, after every lap in the pool, the swimmer 12 could hear the lap count e.g., “Finished lap X”. During play of the performance audio, the entertainment audio stream is paused, and then resumes after the performance data had been spoken.

Step Three. If there are athletic activity instructions, they are provided when triggered (e.g., by time, lap count, distance). The audio stream is provided by the headset 14 as appropriate. The audio stream also causes the entertainment audio stream to be paused while it is delivered. An example of such an audio stream could be instructions like: “Switch to the backstroke on the next lap.”

Step Four. When the coach 18 wants to communicate with an athlete 12, the coach selects a particular athlete to target using the coach's software. The coach then speaks into his or her smart phone or tablet's

microphone

93A, 93

B

93C. The resulting digitized voice stream is sent by the coach's software, along with identification of the targeted athlete 12, to the system communication module 16. The module 16 then sends it on to the correct headset 14 through the appropriate means (for a swimmer this would be modulated ultrasonic audio propagated through the water). When received by the headset 14, this interrupt audio would be immediately delivered to the athlete 12. The entertainment audio stream is then paused. Any performance data delivery is then delayed or discarded. Activity instruction audio is delayed if it is interrupted/interdicted by the interrupt audio.

Step Five. When the headset 14 is out of the water (for example, during a rest period between laps or after a set of laps), recorded performance data from the attached sensors 42 is sent back to the system communication module 16 for archiving and is then relayed to the coach's information appliance. In addition, at this time, new athletic activity instructions and/or audio is downloaded to the individual headset 14 from the system communication module 16, as shown in FIGS. 9 and 10.

Real Time Audio Selection

In one embodiment of the invention, the headset 14 is programmed with software algorithms that are stored in the non-volatile memory 24, and that handle the various audio streams that are available for simultaneous delivery to the athlete 12. FIG. 11 is a flowchart of the decision making process for this particular embodiment of the software.

At decision point 62A, the system plays the entertainment audio stream if there is no other audio ready to play.

At decision point 62B, the system determines if the non-entertainment audio is interrupt audio (coach's voice). If it is, it will be played as the highest priority, and will continue to be played until it terminates/ends. When it ends, the system will check if other non-entertainment audio is ready or has been delayed (in the case of activity instructions).

At decision point 62C, the system plays activity instructions in preference to performance data.

At decision point 62D, the system provides performance data as the lowest priority audio stream. If there is no performance data to provide, the system will go back to playing the previously paused entertainment audio.

A Web Portal

One embodiment of the invention includes a web portal for distributing workouts in a defined format. The web portal enables coaches to sell or to distribute their workouts (e.g., a triathalon training schedule). The web portal not only distributes the workouts, but also gives the coach 18 and the athlete 12 access to the performance data for all workouts recorded with the system and any swim meet results.

Communication from Swimmers

In another alternative embodiment, a microphone is built into the headset to allow the athlete to communicate with the coach. The microphone would enable the swimmer to send audio (speech) over the wireless link 15 to the system communication module 16. The audio data is saved (verbal commentary) and/or transmitted to the coach and/or transmitted to other athletes.

Section Three:

Underwater Ultrasound Communication System

One embodiment of the invention comprises a one-way underwater communication system designed for audio messages, such as speech or music, transmitted to swimmers in a pool from a poolside location. Although a specific embodiment is described below, persons having ordinary skill in the art will appreciate that many design variations may be employed to implement the invention. These variations include, but are not limited to, different frequency bands, numbers of channels, bandwidths, channel selection logic and/or other design configurations.

As shown in FIGS. 12 through 19, one embodiment propagates four broadcast channels labeled A, B, C, and D. These channels occupy separate sub-frequency bands, although other embodiments could use fewer or more channels. In this embodiment, transmissions over the four channels occur generally simultaneously. Channel A only transmits tones used for selecting individual swimmers to receive messages from either or both of two swim coaches, or to broadcast announcements to all swimmers. The coaches talk over channels B and C. Channel D is a default channel (which might contain music) heard by a swimmer when he is not hearing from a coach. However, a specific tonal frequency f0 sent on channel A enables an interrupting announcement on channel D that all swimmers will simultaneously receive. As shown in FIG. 13, either coach can send tonal frequency f0, but other conditions (such as an emergency) could cause f0 to be transmitted.

The individual swimmers are identified by the

numbers

1, 2 . . . N; and each wears an ultrasound receiver with earpieces for hearing. Each coach has a transmitting apparatus connected either by wires or wireless means to a common transmitting hydrophone immersed in the pool. The first coach 18 always talks over channel B, and the second coach 46 always talks over channel C. The selection of an individual swimmer to hear a message from a coach is accomplished by sending a tone of a specific frequency over channel A. For example, if first coach 18 wants to talk to swimmer #3 (but to no others), tone frequency f3 is transmitted on channel A, as shown in FIG. 14. The reception of this tone enables that swimmer to hear first coach 18 talking on channel B. On the other hand, if second coach 46 wants to talk to swimmer # 3, tone frequency fN+3 is transmitted on channel A, enabling swimmer # 3 to hear coach 46 talking on channel C.

The coaches 18 & 46 can talk to more than one swimmer at a time by simultaneously sending more than one tone over channel A. For example, if first coach 18 simultaneously sends tone frequencies f3, f5, and f7 over channel A, swimmers # 3, #5, and #7 can hear the first coach 18 talking over channel B. One or more swimmers can also to hear both coaches 18 & 46 at the same time. For example, if on channel A first coach 18 sends tone frequencies f2 and f6 and second coach 46 sends tone frequencies fN+2 and fN+6, swimmers # 2 and #6 will be able to hear both coaches 18 & 46 talking.

Transmitter Design

FIG. 12 shows channels A, B, C, and D in frequency sub-bands respectively centered at 100 KHz, 150 KHz, 200 KHz, and 250 KHz, although other center frequencies may be employed in alternative embodiments. These sub-bands are shown prior to spectral spreading by a PN code that is described below.

FIG. 13 shows how the selection tones in Channel A are multiplied by a 100 KHz carrier, which shifts them to a spectrum having a 100 KHz center frequency.

FIG. 14 shows the frequency layout of the selection tones in more detail. For N=12 swimmers, a total of 25 tones would be needed. The lowest tonal frequency f0 needs to be high enough to avoid confusion with a pilot # 1 frequency, which is described below. In this embodiment, f0 is 1 KHz. If the tones have 100 Hz spacing, the channel A bandwidth using amplitude modulation would only be about 6800 Hz, while still allowing enough separation for each tone to be easily identified by a swimmers receiver.

FIG. 15 shows the generation of (as yet unspread) channels B, C, and D. The speech 94 channels B and C are limited by low-pass filtering to 3 KHz, which still permits clear speech intelligibility. Channel D has a larger bandwidth of 10 KHz for better music fidelity. The

speech

94, 104 on channels B and C modulate carriers with respective frequencies of 150 KHz and 200 KHz, and the audio on channel D modulates a 250 KHz carrier. Several types of modulation could be used, such as AM (amplitude modulation), DSB (double sideband modulation), SSB (single sideband modulation), FM (frequency modulation), or others. In this embodiment, AM is assumed since it is the simplest to demodulate in a receiver.

FIG. 16 shows how the transmitted signal is formed. The unspread signals 124 in Channels A, B, C, and D are summed in adder 126 to form a single signal to which is added a 100 KHz pilot carrier 128, called pilot # 1. The composite signal is then multiplied by a 30 kchip/sec PN code 130 to form a spread-spectrum signal. The primary purpose of the PN code is to mitigate multipath, which is described in greater detail below. In another embodiment, a second 100 KHz pilot carrier 132, called pilot # 2, is added to the spread signal. Because pilot # 2 is not spread, it may easily be detected and its Doppler shift (due to swimmer motion) is used to facilitate code and carrier acquisition in the swimmer's receiver. After amplification in amplifier 134, the signal is transmitted by a hydrophone 136 with a wide radiation pattern to cover the pool underwater as uniformly as possible.

FIG. 17 shows the spectrum of the signal 143 in FIG. 16 prior to spreading, including the 100 KHz pilot # 1 carrier described above.

FIG. 18 shows the spread-spectrum signal 149 in FIG. 16, plus the optional unspread 100 KHz pilot # 2 carrier.

Receiver Design

A schematic block diagram of one embodiment of a swimmer's receiver is shown in FIG. 19. The received signal is picked up by an omnidirectional hydrophone, and is then amplified. The PN code and 100 KHz pilot # 1 carrier are acquired and tracked within the block at the bottom of FIG. 19. If the optional unspread 100 KHz pilot # 2 carrier has been transmitted, the first step in acquisition is to detect it and measure its frequency to eliminate the need for frequency search during acquisition. The tracker is designed to track the received PN code replica which arrives first, and not later replicas that might arrive via multipath propagation.

After acquisition, the tracker generates the same PN code as that which was transmitted, but which has been compensated for Doppler shift due to swimmer motion, and is aligned with the direct-path received PN code. The received signal is multiplied by the tracking PN code, which despreads all four received channels. By also tracking the despread 100 KHz pilot # 1 carrier, the tracker generates Doppler-compensated frequencies, nominally 100, 150, 200, and 250 KHz, which are used to shift each of the four channels to baseband using complex frequency shifters as shown in the figure. Each baseband channel is lowpass filtered and AM demodulated. The lowpass filter for baseband channel A is made just wide enough to pass all received tones. The channel B and C lowpass filters have a 3 KHz cutoff to pass speech but not higher frequencies. The lowpass filter for channel D has a 10 KHz cutoff to pass music with reasonably good fidelity.

The received selection tones from baseband channel A are fed to a tone decoder, the output of which selects which of the baseband channels B, C, and/or D are to be heard by the swimmer. The specific tone frequencies which enable channels B and C to be heard are unique to the individual swimmers receiver, while the tone frequency f0 which forces and announcement on channel D to be heard is common to all receivers.

In one embodiment, an automatic gain control (AGC) is included in the receiver. Because underwater ultrasound attenuation has a rather severe frequency dependence, in one embodiment, each of the four channels includes an independent AGC circuit.

PN Code Characteristics

The 30 kchip/sec PN code is a shift-register generated maximal length PN sequence of length where N is a positive integer equal to the length of the shift register. The shift register feedback configurations for various values of N are well-known in the art. The normalized autocorrelation function for such a PN sequence has a peak of value −1/(2^N−1) for no chip shift and a constant value of for all shifts greater than 1 chip in magnitude. For a suggested value of N=10, the code consists of a 1023-chip sequence having a repetition period of 0.0341 seconds and a spatial period of 49.8 meters in water. The spatial length of one chip is 4.87 cm. Thus, on each of the 4 channels, any multipath signal with a spatial delay between 4.87 cm and about 49.8 meters relative to the direct path signal will be significantly attenuated. The amount of attenuation increases with the chip rate of the PN code and higher chipping rates may be used if needed.

Digital Implementation

One embodiment of the present invention is configured to achieve low-cost digital implementations of both the transmitter and receiver. Required sampling rates are quite low, digital implementation of the required lowpass filter designs is not very demanding, and arithmetic operations is relatively simple to implement with a microprocessor and/or dedicated chip, including those needed for code/carrier tracking and the tone decoder in the receiver.

All frequencies generated within the transmitter or receiver are relatively low and are easily synthesized from a single oscillator. The oscillator frequency tolerance is not demanding.

Design Tradeoffs

In an alternative embodiment of the invention, the four channel center frequencies could be closer together than described in the previous embodiment, as long as the space between the unspread channel spectra is large enough to allow channel isolation by the lowpass filtering in the receiver. For example, the center frequencies for channels A-D might respectively be 100, 120, 140, and 160 KHz. This reduces the required bandwidth of the transmit and receive hydrophones, probably making them less costly. This also reduces the variation of ultrasound attenuation in the water over the signal bandwidth. These center frequencies cause greater overlap of the spread spectra of the transmitted channels. However, this presents no problems inasmuch as the despreading process in the receiver removes the overlap.

By using SSB modulation instead of AM on each channel, channel bandwidths may be halved, permitting even closer channel spacing and a yet smaller required hydrophone bandwidth. However, SSB modulation/demodulation adds complexity to the system design.

The generation and decoding of selection tones may be made simpler by having at most two tones simultaneously transmitted by a coach. One tone identifies the individual swimmer, and the other identifies the coach, enabling the identified swimmer to hear the identified coach. This embodiment also offers the capability of transmitting a special tone of frequency f0 for an announcement to all swimmers.

If desired, stereo could be transmitted on channel D using I and Q for left and right.

Alternate Embodiments of the Underwater Ultrasound Communication System

In another embodiment of the Underwater Ultrasound Communication System, all four channels are transmitted at the same frequency (for example, 100 kHz) and signals are frequency-spread on the channels using a unique PN code for each channel. At a swimmer's receiver, the signal from an individual channel is recovered by correlation using its PN code as a reference. At the output of the correlator for a given channel, the signals from the other channels appear as wideband noise, most of which are removed by a filter with a bandwidth just large enough to pass the de-spread speech or music information for the given channel.

The selection of a swimmer for communication from either coach is accomplished in the same manner as the original embodiment described above. Also, the optional unspread pilot tone # 2 shown in FIG. 18 can still be transmitted as an aid to acquiring and tracking the received signals on all channels.

For increased reliability in selecting swimmers for communication, each coach 18 and coach 46 swimmer select tone can be replaced with a dual tone using multi-frequency (DTMF) technology, similar to that used in touch-tone telephones. Keypads for producing 10 DTMF signals have low cost and are widely available for telephone use. Any modifications needed to permit each coach to independently select up to ten swimmers should be relatively simple. If necessary, pressing two keys on a DTMF keypad could further expand the number of selectable swimmers.

Section Four:

Magnetic Lap Counter

One embodiment of the invention includes a system for automatic counting of laps for a swimmer through the use of magnetic sensors. Although a specific embodiment for swimmers is described, such a device could be used for any exercise/sport that consists of back and forth movement (such as running laps on an oval track).

General Description

As shown in FIGS. 20 and 21, the magnetic field (shown as magnetic flux lines) of the Earth is constant across the pool, regardless of the direction of motion of the swimmer shown in FIG. 20. When viewed from the point of view of the swimmer (in the swimmer's “body frame”), these flux lines reverse direction when the swimmer switches from the forward to the reverse lap (bottom panel) or from the reverse to the forward lap. These field reversals are sensed to calculate a count of laps swum.

Hardware Sensor Design

One embodiment of the invention includes a set of three magnetic sensors in an orthogonal configuration (“3 axis magnetic sensor”) and a set of three acceleration sensors in an orthogonal configuration (“3 axis accelerometers”). The two sets of sensors are constructed and connected such that the rotational relationship between them is a known, fixed quantity. This configuration allows measurements made by the magnetic sensors to be referenced to measurements made by the accelerometers. In this embodiment, the sensors have identical alignments as shown in FIGS. 22, 23 and 24. The vector measurement from one sensor frame can be converted into the other sensor frame through a constant rotation matrix.
V^M=Ω^M _AV^A
Where VM is the vector in the magnetic sensor frame, VA the vector in the accelerometer sensor frame and Ω^M _Ais the rotation matrix between the two frames.
Basic Measurement Processing

Measurements obtained from the sensors are processed in a low cost/low power microprocessor (or other computing device, such as the headset microprocessor). The accelerometers feel the pull of gravity, and detect a 9.8 m/s/s acceleration “down” towards the center of the Earth (along the “Y” axis in FIGS. 22, 23 and 24). Vertical and horizontal components of the magnetic flux direction are separated using the expression:
H ^M =V ^M −V ^G(V ^M ·V ^G)
Where V^Mis the measured (3 axis) magnetic vector, V^Gis a unit vector in the direction of measured gravity and H^Mis the horizontal component of the magnetic vector. When the sign of H^Mchanges, a “lap” will be counted. FIGS. 22, 23 and 24 show an example where the measurements happen to line up with different axis of the sensors.
Stroke and Body Orientation Changes

In this embodiment, the accelerometers are used to determine if the swimmer has changed “stroke” between laps. Specifically, if the swimmer transitions between a face down swimming style (like breast stroke) to a face up swimming style (like back stroke) the sensor suite will undergo a 180 degree rotation. This is detected by the change in sign of the gravity vector measured by the accelerometers. In the sensor frame (body frame of the swimmer), the gravity vector will switch from pointing “down” to pointing “up” (caused by the sensor suite flipping over). When detected, this is compensated.

Measurement Filtering

In this embodiment, the sensors are attached to the swimmer's body, so they undergo motions related to the swimmer's movements. These motions will be dependent on the actual location of the device on the swimmer's body (for example; motion of the head will be different than motion of the hips). This body motion will be removed from the measurements through appropriate (and standard) mathematical filtering techniques (such as box car averaging, continuous averaging, alpha-beta filters, etc.). The actual filtering algorithms and parameters may vary depending upon placement of the system.

The algorithms that are used for filtering are fixed, or selected, based on attachment position of the system. Or, they can be determined through analysis of the sensor system's motion via the accelerometer readings. Profiles for expected acceleration patterns based on attachment position (head, waist, hips, wrist, etc.) are stored and matched to actual sensor readings. Once the attachment position is determined, the appropriate filtering algorithms can be used to process the measurements for lap counting.

Design Tradeoffs

This embodiment uses three axes of magnetic sensors and three axes of acceleration sensors. Alternative embodiments may employ fewer sensors by restricting the alignment/placement of the system on the athlete. The minimum configuration would include only a single magnetic sensor and no acceleration sensors. Other configurations are also possible. The acceleration sensors provide data that could be processed for other purposes. Such as (but not limited to):

Speed profile during the lap.

Time of “turnover” at the transition from one lap to another.

“Push off” acceleration/force during “turnover”

Scope of the Claims

Although the present invention has been described in detail with reference to one or more preferred embodiments, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the Claims that follow. The various alternatives for providing a Activity Monitoring and Directing System that have been disclosed above are intended to educate the reader about preferred embodiments of the invention, and are not intended to constrain the limits of the invention or the scope of Claims.

LIST OF REFERENCE CHARACTERS

10 One embodiment of Activity Monitoring and Directing System
12 User or athlete
14 Headset
14A Headphones
15 Wireless link
16 System communication module
18 First coach
20 Smart phone or other information appliance
21 Swimmer in the water
22 Processor
24 Non-volatile memory
26 Cyclist and coach
27 Bicycle
28 Athlete module
30 Schematic block diagram of headset
32 Transceiver
34 Antenna
36 Processor
38 Non-volatile memory
40 Power source
42 Sensors including accelerometers
44 Two coaches and system communication module
46 Second coach
48 Second smartphone or other information appliance
50 Detailed schematic block diagram of system communication module
52 Loading audio stream before activity
54 iPhone™ or computer with audio files
56 Communication during activity, while swimming
58 Ultrasonic link
59 Communication during activity, while resting
60 Communication during activity, while resting
62 Flowchart
62A First decision point
62B Second decision point
62C Third decision point
62D Fourth decision point
64 Spectrum use
66 Signal strength
68 Frequency
70 Schematic diagram of circuitry
72 First swimmer selector frequency
73 Second swimmer selector frequency
74 First tone generator
75 Second tone generator
76 Signal adder
78 Reference frequency
80 Unspread Signal A
82 Graph of spectrum use
83 Signal strength
84 Announcement tone
86 Frequency
88 First coach swimmer select tones
90 Second coach swimmer select tones
92 Schematic diagram of circuitry
93 Microphones
94 Coach 18 voice
96 Amplifier
98 3 KHz LPF
100 Modulator
102 Unspread Channel B
104 Coach 46 voice
106 Amplifier
108 3 KHz LPF
110 Modulator
112 Unspread Channel C
114 Music or announcements
116 Amplifier
118 10 KHz LPF
120 Modulator
121 Unspread Channel D
122 Schematic diagram
124 Channels
126 Signal adder
128 100 KHz Pilot No. 1
130 30 kchip/sec spreading PN code
132 100 kHz Pilot No. 2
134 Amplifier
136 Transmit hydrophone
138 Frequency use
140 Signal strength
142 Frequency
143 Complete unspread signal
144 Frequency use
146 Signal strength
148 Frequency
149 Complete signal after spreading
150 Schematic diagram
150-1 Swimmer hydrophone
150- 2 A 30 kchip/sec tracking PN code
150-3 Code & pilot #1 tracker
150-4 Despreader
150-5 Frequency shift
150-6 LPF & demodulation
150-7 Tone decoder for channel selection
150-8 Frequency shift
150-9 LPF & demodulation
150-10 Frequency shift
150-11 LPF & demodulation
150-12 Frequency shift
150-13 LPF & demodulation
150-14 Adder
152 Magnetic flux during laps in pool—pool frame
154 Direction of magnetic flux during forward lap
156 Direction of magnetic flux during reverse lap
158 Magnetic flux during laps in pool—body frame
160 Direction of magnetic flux during forward lap
162 Direction of magnetic flux during reverse lap
164 Gravity and magnetic flux vectors
166 X,Y,Z sensor frame
168 Gravity and magnetic flux vectors on forward lap
170 Gravity and magnetic flux vectors on reverse lap

Claims

What is claimed is:

1. An apparatus for enhancing the experience of a swimmer in the water comprising:

a sensor; said sensor for providing an output; and

an audio headset for a swimmer in the water; said audio headset for a swimmer in the water for receiving a stream of content; said audio headset for a swimmer in the water also for receiving said output from said sensor; said audio headset also including automatic gain control;

said audio headset for a swimmer in the water including a computing device; said computing device including a processor and a non-volatile memory;

said computing device also for converting said output from said sensor to audio information;

said audio headset for a swimmer in the water, being worn by said swimmer, for providing a combination of said stream of content and audio information to said swimmer;

a system communication module;

said system communication module for sending signals with said audio headset;

said system communication module also for sending interrupt audio messages to a swimmer in the water;

said system communication module also for delivering multiple audio streams to said audio headset;

said system communication module also for tracking stroke and body orientation changes of a swimmer in the water;

said system communication module also for logging output from said sensor for evaluation in real time by a coach;

said plurality of signals including a plurality of content channels in a frequency band that generally spans 100 to 250 KHz;

said system communication module also for combining a plurality of ultrasonic communication links used generally simultaneously in the same swimming pool by a plurality of coaches;

said system communication module also for enabling a coach to provide voice commands using a first content channel; said voice commands being conveyed through a first amplifier and a first low pass filter; said voice commands being modulated at a specific frequency using a modulator to produce a first unspread audio channel;

said system communication module for producing a second content channel that is conveyed through a second amplifier a second low pass filter; said second content stream being modulated at a specific frequency using a modulator to produce a second unspread audio channel;

said system communication module also for summing said plurality of content channels to produce a combined signal; said plurality of content channels being summed by a signal adder, and then added to a pilot frequency;

said system communication module also for multiplying said combined signal by a pseudorandom number code, which produces spread spectrum signal;

said system communication module also for adding an unspread pilot frequency signal to said combined signal to ease the process of signal tracking at said audio headset;

said system communication module also for increasing the level of the combined signal using a third amplifier to produce a transmission signal before being transmitted to said headset via an omnidirectional hydrophone;

said audio headset for receiving said transmission signal;

said audio headset also for splitting said transmission signal into a plurality of channels that may be used by said swimmer;

said sensor including a magnetometer for lap counting;

said sensor further including

a plurality of magnetic sensors arranged in a mutually orthogonal configuration;

a plurality of acceleration sensors in a mutually orthogonal configuration;

said plurality of magnetic sensors and said plurality of acceleration sensors being used to count laps and to determine speed;

said audio headset for receiving ultrasonic signals through water;

said ultrasonic signal being propagated as a composite signal multiplied by a PN code to form a spread spectrum signal which mitigates multipath distortion;

said ultrasonic signal including a pilot signal; said pilot signal being used to facilitate code and carrier acquisition in said headset to compensate for Doppler shift due to the motion of said swimmer;

said ultrasonic signal being transmitted by said omnidirectional hydrophone with a wide radiation pattern to cover the pool underwater as uniformly as possible;

a web portal:

said system communication module also for distributing workouts through said web portal;

said web portal for providing a connection to performance data for workouts and swim meet results.

2. An apparatus as recited in claim 1, in which said sensor is configured to supply real-time information.

3. An apparatus as recited in claim 1, in which said sensor includes a radio for emitting a wireless output that may be received by said audio headset.

4. An apparatus as recited in claim 1, in which said sensor is a swimmer's lap counter.

5. An apparatus as recited in claim 1, in which said sensor is a heart rate monitor.

6. An apparatus as recited in claim 1, in which said sensor is a respiration monitor.

7. An apparatus as recited in claim 1, in which said sensor is a swimmer's stroke counter.

8. An apparatus as recited in claim 1, in which said sensor measures a swimmer's speed.

9. An apparatus as recited in claim 1, in which said sensor records a swimmer's lap time.

10. An apparatus as recited in claim 1, in which said memory in said processor stores a plurality of pre-recorded voice messages which are conveyed to said audio headset based on a signal received from said sensor.

11. An apparatus as recited in claim 1, in which said audio headset includes a radio for receiving said stream of content.

12. An apparatus as recited in claim 1, in which said audio headset includes a radio for receiving said output of said sensor.

13. An apparatus as recited in claim 1, further comprising:

a systems communication hub; said systems communication hub including a processor and a non-volatile memory;

said systems communication hub including a radio for providing wireless communications to said audio headset;

said systems communication hub for providing information to said swimmer from another person.

14. An apparatus as recited in claim 11, further comprising:

a microphone; said microphone being attached to said audio headset;

said microphone for receiving ambient sound and for enabling a first person to send voice information using said radio to another person.

15. An apparatus as recited in claim 1, in which said stream of content includes entertainment.

16. An apparatus as recited in claim 1, further comprising:

a remote transceiver; said remote transceiver including a processor and a non-volatile memory and a radio.

17. An apparatus as recited in claim 16, in which said remote transceiver is a smart phone.

18. An apparatus as recited in claim 16, in which said remote transceiver is a tablet.

19. An apparatus as recited in claim 16, in which said remote transceiver is used by a coach for communicating with said swimmer wearing said audio headset.

20. An apparatus as recited in claim 1, further comprising:

a remote server;

said remote server including a processor and a non-volatile memory;

said non-volatile memory including a web portal software program;

said web portal software program for conveying information received from said audio headset to other persons who connect to said remote server.

21. An apparatus as recited in claim 20, in which data from said sensor is archived on said remote server.

22. An apparatus as recited in claim 20, in which data from said sensor is retrieved from said remote server.

23. An apparatus as recited in claim 1, in which said sensor includes an accelerometer for performance measurement.