Park YL IOP BB 2014
Park YL IOP BB 2014
Design and control of a bio-inspired soft wearable robotic device for ankle–foot rehabilitation
This content has been downloaded from IOPscience. Please scroll down to see the full text.
(http://iopscience.iop.org/1748-3190/9/1/016007)
View the table of contents for this issue, or go to the journal homepage for more
Download details:
       IP Address: 128.237.196.159
       This content was downloaded on 16/01/2014 at 16:59
Abstract
We describe the design and control of a wearable robotic device powered by pneumatic
artificial muscle actuators for use in ankle–foot rehabilitation. The design is inspired by the
biological musculoskeletal system of the human foot and lower leg, mimicking the
morphology and the functionality of the biological muscle–tendon–ligament structure. A key
feature of the device is its soft structure that provides active assistance without restricting
natural degrees of freedom at the ankle joint. Four pneumatic artificial muscles assist
dorsiflexion and plantarflexion as well as inversion and eversion. The prototype is also
equipped with various embedded sensors for gait pattern analysis. For the subject tested, the
prototype is capable of generating an ankle range of motion of 27◦ (14◦ dorsiflexion and 13◦
plantarflexion). The controllability of the system is experimentally demonstrated using a linear
time-invariant (LTI) controller. The controller is found using an identified LTI model of the
system, resulting from the interaction of the soft orthotic device with a human leg, and
model-based classical control design techniques. The suitability of the proposed control
strategy is demonstrated with several angle-reference following experiments.
Keywords: soft robotics, bio-inspired robotics, wearable robotics, active orthosis, pneumatic
artificial muscles (PAMs), soft sensors, feedback control
(Some figures may appear in colour only in the online journal)
1. Introduction                                                       assistance during gait but also for preventing the development
                                                                      of abnormal gaits over time.
Ankle–foot pathologies in patients with neuromuscular                      In this paper, we present an active soft orthotic
disorders, caused by cerebral palsy (CP), amyotrophic lateral
                                                                      device—incorporating sensing, control, and actuation—for
sclerosis, multiple sclerosis, or stoke, can result in abnormal
gaits over time, such as drop foot, equinus, and crouch               use in treating ankle–foot pathologies associated with
gait [1]. The treatment of these pathologies using active             neuromuscular disorders [2]. The design mimics the
orthotics has the potential not only for providing immediate          muscle–tendon–ligament–skin architecture in the biological
                                                                      2
Bioinspir. Biomim. 9 (2014) 016007                                                                                             Y-L Park et al
(a)
(b)
Figure 2. Main design of the active soft orthotic device (highlighting key components). (a) Front view of the prototype integrated on a
human leg showing the three anterior muscles (M1: tibialis anterior, M2: extensor digitorum longus, and M3: peroneous tertius). (b) Side
view of the prototype showing the posterior muscle (M4: gastrocnemius) and the strain sensors.
2.1. Base                                                               foot stability control during the ground contact phase of
                                                                        walking.
The base layer contains the foot, ankle, and knee braces that                The actual prototype worn on a subject’s right leg is shown
make physical contacts with the wearer’s skin. Through this             in figure 2. Four off-the-shelf pneumatic artificial muscles
layer, the actuation forces are transmitted to the human body. A        (DMSP-10-120-200, 180, 160, and 140, Festo, Esslingen,
flexible commercial knee strap (419 Multi-Action Knee Strap,            Germany) were used for actuation, and two off-the-shelf
McDavid, Woodridge, IL 60517, USA), an ankle brace (511                 miniature solenoid valves (NEX-2-03-L, Parker Hannifin
Elastic Ankle Support, McDavid, Woodridge, IL 60517, USA),              Corp., Cleveland, OH 44124, USA) were installed for air
and a leather shoe (Performa, Vibram, Albizzate, Italy), with           injection and release of each muscle. The proximal side of
no rigid components, were modified to be used as the knee,              each muscle was anchored to the knee brace, and the distal side
ankle, and foot braces, respectively.                                   was anchored to the foot brace through metal tendon cables
                                                                        that are flexible but inextensible. Metal hooks were firmly
2.2. Actuation                                                          sewn onto the multiple places of the knee and foot braces to
                                                                        provide anchoring points for the tendon cables. The hooks
The actuation layer is composed of artificial muscles, tendons,         made the muscles easy to attach to and detach from the braces.
and ligaments. Four artificial muscles were placed on the lower         Since the knee brace has anchoring points only below the knee
leg (three anterior muscles for dorsiflexion, inversion, and            joint, the device does not constrain the knee range of motion.
eversion, as well as one posterior muscle for plantarflexion),          Muscles 1 and 3 (mimicking the tibialis anterior and peroneous
with their artificial tendons anchored at the knee brace                tertius, respectively) provide inversion and eversion functions,
and the foot brace. The artificial muscles were designed                respectively, as well as active dorsiflexion, while muscle 2
as counterparts to the biological muscles for dorsiflexion,             (mimicking the extensor digitorum longus) provides only
plantarflexion, inversion, and eversion, respectively, so that          dorsiflexion. Muscle 4 (mimicking gastrocnemious) provides
the device could provide the supplementary forces to the                active plantarflexion. Figure 3 shows possible active ankle
corresponding muscles. The artificial tendons were placed               motions generated by different combinations of actuated
close to where the corresponding biological tendons were                muscles. This agonist–antagonist muscle architecture not only
located. As the artificial muscles contract, their artificial           can create desired ankle motions but also can provide physical
tendons pull the anchors on the foot brace, resulting in                support by increasing the stiffness of the ankle joint with co-
a corresponding ankle motion. To prevent the knee brace                 contraction.
from slipping during actuation, thin non-slip silicone pads                  Figure 2(a) shows the tendon system. While muscles 1, 3,
were firmly fixed at the inside of the knee brace making                and 4 each have only one anchor on the distal side, muscle 2
physical contacts to the wearer’s skin. Since the four artificial       has multiple anchors on the foot brace. The differential tendon
muscles can be actuated independently, they can generate                mechanism of muscle 2, similar to the foot design of a wall-
active mediolateral motions, such as inversion and eversion,            climbing robot [29], distributes the pulling force from one
as well as active sagittal motions, such as dorsiflexion and            tendon cable to four anchors. Flexible Teflon    R
                                                                                                                            tubes, sewn
plantarflexion. These mediolateral motions will be useful for           onto the foot brace, secure the paths of force transmission
                                                                    3
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                    Y-L Park et al
                  (a)
                 (a)                     (b)                      c(c)
                                                                ((c))              (d)                  (e(e)
                                                                                                        (e))             (f )              (g)
                                                                                                                                            (g)
                                                                                                                                            (g)                (h)
Figure 3. Actively assisted ankle motions: (a) dorsiflexion (b) with all three anterior muscles contracted; (c) plantarflexion (d) with only
muscle 4 contracted; (e) inversion ( f ) with only muscle 1 contracted; (g) eversion (h) with only muscle 3 contracted.
                                                                θ                  θ
                                                                          θ
       a2        θ2                                      a3                   a1
                   θ1                                                    a2
                                  θ3               a4
                 a1
                                a3
(c)                        a3                                                                Figure 5. (a) Strain sensor prototype with dimensions. (b) Prototype
                                 r3
                                                                                             in action showing resistance change with strain (unit: ).
            a2        r2          φ2       r4     a4
                                  φ1
                            r1                                                               2.3. Sensing
                 a1
                                                                                             The sensors are the outermost layer of the prototype and are
Figure 4. Actuation system configuration and its parameters                                  composed of three sensing modalities. We are interested in
(ai : anchor location of tendon i, Fi : contraction force of muscle i                        information about the configuration of the leg and how the
connected to tendon i, θi : vertical angle of tendon i, and φi :
horizontal angle of tendon i.). (a) Side view of foot to show sagittal                       user is interacting with the ground. Thus we focus on strain,
motions. (b) Front view of foot to show mediolateral motions. (c)                            inertial, and pressure sensors.
Top view of foot.
                                                                                             2.3.1. Strain sensor.    Two custom-built strain sensors were
by allowing the cables to smoothly slide through with muscle                                 used for measuring the ankle joint angles, as shown in
actuation. In addition to the teflon tubes, the artificial ligaments                         figure 2(b). One was attached on the dorsal side of the
made of nylon straps were added to constrain the lateral                                     ankle for measuring sagittal angle changes, and the other
motions of the cables while allowing only axial motions.                                     was placed on the medial side for detecting mediolateral
     Figure 4 shows how the actuation system of the prototype                                motions. Although there are different types of commercial
applies torques to the ankle based on the foot and ankle                                     strain gauges, none of them are designed for accurately
models in [6]. Dorsiflexion is achieved by the cooperation                                   measuring large strain on a flexible surface. Figure 5 shows
of three anterior muscles, and plantarflexion by the posterior                               the design and the actual prototype of the custom-built
                                                                                             strain sensors. Microchannels, filled with a liquid metal
muscle. Assuming the force directions at the tendon anchors
                                                                                             alloy, Eutectic Gallium–Indium (EGaIn), were embedded in
are perpendicular to the sagittal plane, their torques can be
                                                                                             a silicone elastomer (EcoFlex0030, Smooth-On, Inc., Easton,
calculated as
                                                                                             PA 18042, USA) sheet, as described in [30]. When the material
τdorsi = F1 r1 sin θ1 cos φ1 + F2 r2 sin θ2 + F3 r3 sin θ3 cos φ2 ,                          experiences axial strain, the overall channel length increases
                                                                                             and the cross-sectional areas of the channels decrease resulting
                                                                                   (1)
                                                                                             in increased electrical resistance of the microchannel. Since
                                                                                             the microchannels are filled with liquid, the strain sensor is
τplantar = F4 r4 .                                                                 (2)       highly flexible and stretchable. The channel size is 250 μm ×
In the same way, the torques for mediolateral motions are                                    250 μm, and the overall thickness of the sensor is 1.5 mm. The
                                                                                             nominal resistance at rest is 10.3 . The experimental gauge
                           τinversion = F1 r1 sin θ1 sin φ1 ,                      (3)       factor of the strain sensor is 3.4. The gauge factor did not show
                                                                                             any noticeable difference with a relatively mild temperature
                           τeversion = F3 r3 sin θ3 sin φ2 .                       (4)       change (between 20 and 40 ◦ C), which was acceptable for an
                                                                                             indoor rehabilitation device as its current form. However, a
Based on the configurations of the artificial tendons and                                    thorough investigation on the performance with more extreme
the dimensions of the prototype, the maximum torques                                         temperature changes is one of our on-going research areas to
the system can apply are 110 Nm, 53 Nm, 20 Nm, and                                           make the device more mobile and assistive in the future. More
21 Nm for dorsiflexion, plantarflexion, inversion, and eversion,                             details on this strain sensor, such as design, fabrication, and
respectively.                                                                                calibration, can be found in [31, 32].
                                                                                         4
Bioinspir. Biomim. 9 (2014) 016007                                                                                             Y-L Park et al
                                                                   5
Bioinspir. Biomim. 9 (2014) 016007                                                                                              Y-L Park et al
(a)
(b)
                                                                     6
Bioinspir. Biomim. 9 (2014) 016007                                                                                                Y-L Park et al
Table 1. Pneumatic muscle geometries and gas consumptions when              such as the ankle stiffness of a given individual or the actuator
fully contracted (air pressure: 570 kPa).                                   speed, are unknown or difficult to estimate. These complexities
                   Radius      Length   Volume   Air     CO2                make modeling from first principles very difficult. Also, in
       Muscle      (cm)        (cm)     (cm3 )   (g)     (g)                general, it is not uncommon that highly complex systems
                                                                            exhibit nonlinear dynamics that are not easy to model with
       M1          1           13.5     42.4     0.31    0.47
       M2          1           12       47.7     0.28    0.42               a priori information only. Further difficulties arise from the
       M3          1           10.5     33.0     0.24    0.37               injection of unexpected voluntary or involuntary disturbances
       M4          1           15       47.1     0.34    0.51               by the human subject, which demand a control system
       Total                                     1.17    1.77               capable of rejecting low- and medium-frequency disturbances.
                                                                            A third set of challenges reflects the fact that, in general,
                                                                            pneumatic actuators are not easy to model and control. In
27◦ (14◦ dorsiflexion and 13◦ plantarflexion) for the case study
                                                                            particular, although the actuators of the kind considered here
subject.
                                                                            are lightweight, compliant, and capable of generating large
     We also tested repeated dorsiflexion and plantarflexion.
                                                                            forces, it has been argued that pneumatic actuators have
The system carried out the characterization program
continuously for about 2 min. The result, figure 8(b), shows                not been widely used in rehabilitation and assistive robotics
the system could achieve the same angles reliably. While the                because they are difficult to control [38]. McKibben pneumatic
target angles were obtained, the angle held gradually decreased             artificial muscles, for example, are very challenging to model
during the holding phase due to air leakage of the valves. Thus,            from first principles or characterize dynamically, and thus,
feedback control is necessary for more accurate joint angle                 they have been primarily modeled using a static approach
control, which will be discussed in section 4.                              [39, 40]. This might explain that, to date, the pneumatic robotic
                                                                            systems in which sophisticated control strategies have been
                                                                            implemented are composed of rigid moving parts [38, 41, 42],
3.3. Power consumption
                                                                            and that, when artificial muscles have been used, the control
3.3.1. Electric power. The system consumes relatively small                 strategies are mostly model-free, tuning-based or based on
electric power as the actuation is pneumatically powered.                   heuristic methods such as fuzzy logic [43–45].
Three rechargeable lithium-ion batteries (3.7V-900mAh,                            There exists an extensive literature on first-principles-
Sparkfun Electronics, Boulder, CO 80301, USA) provide                       based static modeling of McKibben artificial muscles, in
enough power to operate the entire system for more than 2 h.                which the objective has been to find relationships between
The control hardware, excluding the solenoid valves, requires               the actuator tension, length, and air pressure [39, 40, 46]. This
2.5 W, and the valve circuits require 1.5 W on average.                     line of research is useful for understanding the capabilities and
                                                                            limitations of the actuators. However, static modeling is not
3.3.2. Pneumatic gas consumption.               Pneumatic power             sufficient for devising trajectory-following high-performance
consumption can be analyzed based on the pressure and the                   controllers. An alternative approach follows from observing
volume of the compressed air consumed for actuation using                   that, under controlled experimental conditions, the McKibben
the ideal gas law. The volume of air can be calculated from                 actuator exhibits a behavior that can be modeled as a second-
the geometry of the contracted muscles. Assuming the gas is                 order system that maps the effective force generated by the
consumed isothermally, and the molar masses of air and CO2                  contractile element to the resulting actuator displacement,
are 29 g and 44 g, respectively, the four muscles consume the               provided that the actuation pressure remains constant [43, 47].
total of either 1.17 g of air or 1.77 g of CO2 in one full actuation.       This kind of model depends on three parameters that can be
Table 1 summarizes the geometry and gas consumption of                      interpreted as a mass, a spring coefficient and a damping
each muscle when contracted with pressure of 570 kPa. For                   coefficient, which depend on the actuation pressure. Thus,
portability, a commercially available cylinder (5GAR9, W. W.                assuming small variations of the actuation pressure and using
Grainger Inc., Lake Forest, IL 60045, USA) that contains 567 g              appropriate sensors, a control strategy to follow a desired
of liquid CO2 at 827 kPa can be carried with the device. One                actuation displacement. However, for angular trajectory
cylinder can provide more than 320 full actuation cycles of all             following, this is not practical because we still need a way
four muscles assuming isothermal gas consumption.                           to exactly specify and generate the required effective force.
                                                                            Furthermore, estimating only two parameters for a fixed-
4. Control                                                                  structure low-order model almost certainly would not capture
                                                                            the complex dynamics of the system proposed here.
Once the basic characterization of the sensing and actuation                      Considering the issues described above, we avoid
systems interacting with the human subject is completed,                    modeling the robotic-human system from first principles and
a model-based feedback controller is designed such that                     instead treat the system as a black box for which we estimate
the orthotic system is used to track desired ankle angular                  an input–output LTI dynamic mapping, using a subspace
trajectories. The development of such a controller poses several            system identification technique. Once a model of the system
challenges, which need to be resolved in order to meet the                  is found through system identification, a model-based single-
desired requirements of the orthotic system as a rehabilitation             input–single-output (SISO) LTI controller is designed. The
tool. Numerous complexities arise as the combined human-                    idea of treating this complex robotic configuration, which
orthotic system is a complex plant where relevant parameters,               mechanically interacts with a human leg, as a black box is
                                                                        7
Bioinspir. Biomim. 9 (2014) 016007                                                                                                Y-L Park et al
                                                                    8
Bioinspir. Biomim. 9 (2014) 016007                                                                                                      Y-L Park et al
                                                                   Pneumatic
            u(t)       PWM           w(τ ) Pneumatic                Actuators                   Strain              A/D &          y(t)
                      Generator               Valves               Interacting                  Sensor           Transformation
                                                                with Human Leg
Figure 10. Upper-level physical description of the system from an input–output perspective, according the definitions of u(t ) and y(t ). Note
that y(t ) is a physical variable (angular position), whereas u(t ) is not a physical entity but a mathematical tool used for controller design.
                                                 d(t)
          u(t)                                          y(t)
                            P (z)            +
                                                                          9
Bioinspir. Biomim. 9 (2014) 016007                                                                                                             Y-L Park et al
                                                                                                                                            d(t)
                                                                                           yd (t)                  uK (t)                          y(t)
                                                                                                +        K(z)                P̂ (z)       +
                                                                                               −
Figure 13. Output signal used in the LTI system identification of the
plant P. Upper plot: complete output sequence used in the system                    sampled, the control signal u(t ) computed, and then using the
identification. Bottom plot: close-up of the output signal used in the              information in u(t ), PWM commands are sent to the solenoid
system identification. This segment shows 20 s of the signal.                       valves that activate the actuators. The algorithms processing
                                                                                    the signals required for the control loops are run at 50 Hz,
                                            Identified Model of Plant P             limited by the response time of the solenoid valves (20 ms).
                      20
                                                                                          When the sensor signal is converted to an angle, a
                       0                                                            reference input is either generated from a predefined trace
    Magnitude (dB)
90
                                                                                    functions.
                       0
                                                                               10
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                                       Y-L Park et al
10
                                                                                      Angle (deg)
                                                                                                     2.5
    Magnitude (dB)
-10 0
                                                                                      Input [-1:1]
                                                                                                     0.5
Phase (deg)
90
                                                                                                       0
                       0
                                                                                                     -0.5
                     -90                                                                              -1
                                                                                                            0   2.5   5   7.5   10   12.5   15   17.5   20   22.5   25     27.5    30
                                                                              11
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                                   Y-L Park et al
Table 2. Performance measured as the experimental standard deviation (ESD) of the control error, expressed as a percentage of the angle
range 100% STD(Control   error)
                angle range
                                .
                                                                                                      Signal amplitude
                                                                                                                          Low              High
                    Experimental case                 2.5◦     5◦             7.5◦                        10◦             (figure 23(a))   (figure 23(b))
2.5◦ , the behavior of the system can be considered LTI, as                     (a)                      Control Signal u(t) for Sinusoidal Reference (0.4 Hz; 2.5 )
uK (t ) rarely saturates and u(t ) ≈ uK (t ), as evidenced from the                             1
                                                                              Input [-1:1]
                                                                                             0.5
it is clear that the measured signal y(t ) closely follows the
reference yd (t ). However, as shown in table 2, as the amplitude                               0
                                                                                             [0 0]’
speeds of the artificial muscles are directly proportional to the
amplitude of the reference yd (t ), i.e.,
                    sd (t ) = AgAd ω cos(ωt ),                   (11)                        [1 0]’
                                                                                                    15      15.2   15.4      15.6   15.8   16   16.2   16.4   16.6       16.8    17
where sd (t ) is the desired speed of contraction and expansion,                                                                       Time (sec)
ω is a fixed frequency, Ag ∈ R++ is a geometric constant, and
                                                                              Figure 19. Upper plot: short section of the time-series of u(t ) from
Ad is the amplitude of the angular reference. Note that the
                                                                              the experimental case 1(a). Bottom plot: resulting valve’s state v(τ ),
speed of a McKibben actuator depends on the actuator itself,                  corresponding to the section of u(t ) in the upper plot.
but also on the actuation pneumatic valves, which in this case
are the main cause of speed limitation.                                       effect of the force disturbance acting on the system. Recall that
     The last plots associated with case 1 are shown figure 19,               here, performance is measured using the ESD of the control
which is an example of the mapping from u to v. An interesting                error signal as a percentage of the reference angle range.
thing to notice in figure 19 is that, as described in definition 1,           Interestingly, in case 2, as can be observed in figure 20, as the
if the signal u does not hit the saturation limits, the idealized             percentage performance in table 2 improves with amplitude,
valve’s state v changes during a time cycle. In other words, in               the absolute control error increases with amplitude. The first
the system considered here, saturation means that the idealized               phenomenon is explained by the saturation of uK (t ) caused
valve’s state v stays constant over the whole time cycle.                     by the speed constraint of the actuators, already discussed
     In the second set of experiments, the objective is to test               above. The second phenomenon can be explained by noticing
the system when subjected to a significant constant force                     that the most notable effect produced by the force disturbance
disturbance. In this case, a large weight (500 g) counteracting               is a high frequency oscillation over the measured signal yd (t ),
the dorsiflexion of the subject’s leg is hanged at the distal                 which has an amplitude that stays approximately constant as
end of the foot, which experimentally simulates the case                      the reference angle’s amplitude is varied. The existence of
of patients with highly contracted gastrocnemius muscles, a                   this high frequency content is the direct result of the orthotic
typical characteristic of a drop foot symptom in CP. The chosen               system’s slow response speed. Overall, the capability of the
references are the same used in the first set of experiments. In              closed-loop system to reject disturbances, according to what
both cases shown in figure 20, it is clear that the measured                  is predicted by the estimate of Ŝo in figure 17, is demonstrated
signal y(t ) closely follows the reference yd (t ), and overall,              in figure 20(a). This indicates that the chosen control strategy
the achieved performance is good enough to suggest that the                   is adequate for this kind of system and that the limitations in
robotic orthotic system could be employed as a rehabilitation                 performance reflect physical limitations of the hardware. The
device. Note that in this case, as shown in table 2, for                      performances of all the variants of case 2 are shown in table 2.
each amplitude considered (2.5◦ , 5◦ , 7.5◦ , 10◦ ), the resulting                 Figures 21 and 22 show the experimental sets 3 and 4,
performance is degraded with respect to case 1, due to the                    which are aimed at testing how well the system performs at
                                                                         12
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                                                                     Y-L Park et al
(a)                          Sinusoidal Ref. (0.4 Hz; 2.5 ) and Const. Disturbance                               (a)                          Sinusoidal Reference (Freq. 0.4 Hz; Amp. 2.5 )
                   5                                                                                                                 5
 Angle (deg)
                                                                                                                    Angle (deg)
                  2.5                                                                                                              2.5
0 0
                                                                                                                    Input [-1:1]
                  0.5
 Input [-1:1]
0.5
0 0
-0.5 -0.5
                   -1                                                                                                               -1
                     0         2.5    5   7.5    10   12.5   15   17.5   20      22.5    25     27.5   30                                 0   2.5   5   7.5   10   12.5   15   17.5   20   22.5   25     27.5    30
(b)
                             Sinusoidal Ref. (0.4 Hz; 10 ) and Const. Disturbance                                (b)                           Sinusoidal Reference (Freq. 0.4 Hz; Amp. 10 )
                  12.5                                                                                                          12.5
                   10                                                                                                             10
                   7.5                                                                                                           7.5
                                                                                                                 Angle (deg)
Angle (deg)
                    5                                                                                                              5
                   2.5                                                                                                           2.5
                    0                                                                                                              0
                  -2.5                                                                                                          -2.5
                    -5                                                        Reference yd(t)                                     -5                                                   Reference yd(t)
                  -7.5                                                                                                          -7.5
                   -10                                                        Measured Angle y(t)                                -10                                                   Measured Angle y(t)
                -12.5                                                                                                          -12.5
                         0      2.5   5    7.5   10   12.5   15   17.5   20       22.5   25     27.5   30                                 0   2.5   5   7.5   10   12.5   15   17.5   20   22.5   25      27.5   30
                   0.5
   Input [-1:1]
0.5
0 0
-0.5 -0.5
                    -1                                                                                                               -1
                         0      2.5   5    7.5   10   12.5   15   17.5   20       22.5   25     27.5   30                                 0   2.5   5   7.5   10   12.5   15   17.5   20   22.5   25      27.5   30
                                                       Time (sec)                                                                                                  Time (sec)
Figure 20. Second set of experiments. In both experimental cases,                                                Figure 21. Third set of experiments. In both experimental cases,
(a) and (b), the system is subjected to the force constant disturbance.                                          (a) and (b), upper plot shows the time-series of the reference signal
In both cases, (a) and (b), upper plot shows the time-series of the                                              yd (t ) and the measured angular position y(t ), the controlled
reference signal yd (t ) and the measured angular position y(t ), the                                            variable. In both cases, the bottom plot shows the time-series of the
controlled variable. In both cases, the bottom plot shows the                                                    corresponding signal u(t ). In (a), the reference is a sinusoid with
time-series of the corresponding signal u(t ). In case (a), the                                                  amplitude 2.5◦ and frequency 0.8 Hz. In (b), the reference is a
reference is a sinusoid with amplitude 2.5◦ and frequency 0.4 Hz. In                                             sinusoid with amplitude 10◦ and frequency 0.8 Hz.
case (b), the reference is a sinusoid with amplitude 10◦ and
frequency 0.4 Hz.
                                                                                                                 in (11). The resulting performances of all the variants of cases
                                                                                                                 3 and 4 are also shown in table 2.
higher required speeds, demonstrate the controller capabilities                                                       Figure 23 shows the experimental set 5. In case 5(a),
and expose situations where the limitations of the hardware                                                      the reference is an experimentally-recorded amplitude-scaled
design come into play. In case 3(a) and (b), the references are                                                  walk signal. As expected from the experimental cases already
sinusoids with a fixed frequency of 0.8 Hz, with amplitudes                                                      shown and from figure 17, it is clear that the measured
                                                                                                                 signal y(t ) closely tracks the reference yd (t ). However,
2.5◦ and 10◦ , respectively. In case 4(a) and (b), the references
                                                                                                                 despite the fact that the amplitude of the desired output yd (t )
are sinusoids with a fixed frequency of 1.0 Hz, with amplitudes
                                                                                                                 has a relatively small amplitude, the signal uK (t ) saturates
2.5◦ and 10◦ , respectively. The results in figures 21(a) and                                                    repeatedly. This phenomenon is due to the higher frequency
22(a) show that the proposed control strategy is adequate,                                                       content, in comparison to the signals considered in the
as predicted by Ŝo and T̂ . However, figures 21(b) and 22(b)                                                    previously presented cases, in this new reference. References
unequivocally demonstrate that the system is subjected to a                                                      with higher frequency content imply higher requirements of
hard physical speed constraint. This follows from noticing                                                       contraction and expansion speeds from the artificial muscles.
that the desired speed of contraction and expansion sd (t ) is                                                   As expected, the saturation phenomenon becomes worse when
directly proportional to the reference frequency ω, as shown                                                     the walking reference signal is scaled to a magnitude similar
                                                                                                            13
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                                                                  Y-L Park et al
(a)                          Sinusoidal Reference (Freq. 1.0 Hz; Amp. 2.5 )                              (a)                                     Amplitude-Scaled Walk Reference
                    5                                                                                                      7.5
                                                                                                                            5
   Angle (deg)
                                                                                                         Angle (deg)
                  2.5
                                                                                                                           2.5
0 0
                                                                                                                        -2.5
                  -2.5                                                Reference yd(t)                                                                                                Reference yd(t)
                                                                                                                            -5
                                                                      Measured Angle y(t)                                                                                            Measured Angle y(t)
                   -5                                                                                                   -7.5
                     0       2.5   5   7.5   10   12.5   15   17.5   20   22.5   25     27.5   30                                0    2.5    5     7.5    10   12.5    15   17.5    20     22.5    25   27.5      30
                                                                                                         Input [-1:1]
                                                                                                                           0.5
   Input [-1:1]
0.5
0 0
-0.5 -0.5
                   -1                                                                                                       -1
                     0       2.5   5   7.5   10   12.5   15   17.5   20   22.5   25     27.5   30                                0    2.5    5     7.5    10   12.5    15   17.5    20     22.5    25   27.5      30
                   0.5                                                                                                      0.5
   Input [-1:1]
0 0
-0.5 -0.5
                    -1                                                                                                       -1
                         0   2.5   5   7.5   10   12.5   15   17.5   20   22.5   25     27.5   30                                 0    2.5   5      7.5   10    12.5   15    17.5   20      22.5   25      27.5   30
Figure 22. Fourth set of experiments. In both experimental cases,                                        Figure 23. Fifth set of experiments. In both experimental cases,
(a) and (b), upper plot shows the time-series of the reference signal                                    (a) and (b), upper plot shows the time-series of the reference signal
yd (t ) and the measured angular position y(t ), the controlled                                          yd (t ) and the measured angular position y(t ), the controlled
variable. In both cases, the bottom plot shows the time-series of the                                    variable. In both cases, the bottom plot shows the time-series of the
corresponding signal u(t ). In (a), the reference is a sinusoid with                                     corresponding signal u(t ). In case (a), the reference is an
amplitude 2.5◦ and frequency 1.0 Hz. In (b), the reference is a                                          amplitude-scaled walking signal ranging from −1◦ to 5◦ ,
sinusoid with amplitude 10◦ and frequency 1.0 Hz.                                                        approximately. In case (b), the reference is an amplitude-scaled
                                                                                                         walking signal ranging from −10◦ to 12.5◦ , approximately.
to those in the technical literature showing normal walking
patterns [55], as shown in figure 23(b). Despite the saturation
                                                                                                         tracking constant signals, which adds evidence to the notion
issue, the experiments in figure 23 present compelling evidence
                                                                                                         that the proposed robotic system has a substantial potential
on the robotic orthotic system capabilities to be employed in
                                                                                                         as a rehabilitation device. Finally, notice that the saturation
rehabilitation and on the potential capabilities as a walking
                                                                                                         phenomenon appears in both cases, more dramatically
assistive device. The resulting performances of case 4 are
                                                                                                         underlined in figure 24(b). The resulting performances of all
shown in table 2.
                                                                                                         the variants of case 6 are shown in table 2.
      Figure 24 shows the experimental set 6. In case 6(a),
the reference is a 0.1 Hz-square-wave with an amplitude of
2.5◦ . In case 6(b), the reference is a 0.1 Hz-square-wave                                               5. Discussion and future work
with an amplitude of 10◦ . These cases clearly show the
capabilities and limitations of the robotic system. From both                                            The main contribution of this work is the biologically inspired
cases it follows that the maximum angular speed achievable                                               design and development of a soft wearable robot. The
by the system is 14◦ s−1 , approximately. Also, as predicted by                                          following features make the proposed system novel compared
figure 17, it follows that the control strategy is adequate for                                          to prior wearable assistive devices.
                                                                                                    14
Bioinspir. Biomim. 9 (2014) 016007                                                                                                                                         Y-L Park et al
(a)                                   Square-Wave Reference (0.1 Hz; 2.5 )                                          rehabilitation without limiting 3D motion of the foot. The
                   5                                                                                                performance of the device when applying a feedback controller
                                                                                                                    was also demonstrated. The current prototype demonstrated
Angle (deg)
                  2.5
                                                                                                                    full integration of sensing, actuation, and power to create a
                   0                                                                                                nearly untethered system.
               -2.5                                                          Reference yd(t)                             While the system consumes very little electric power and
                                                                             Measured Angle y(t)                    could run on batteries for several hours, the device still relies
                   -5
                        0      2.5    5    7.5    10   12.5    15   17.5    20     22.5    25   27.5      30        on an air source connection for the pneumatic muscles. Thus,
                                                       Time (sec)                                                   one area of on-going work is the investigation of solutions
                             Signal u(t) for Square-Wave Reference (0.1 Hz; 2.5 )                                   that allow complete untethered operation. Available options
                   1                                                                                                include portable air compressors and compressed air canisters.
                                                                                                                    For the long-term success of such orthotic devices, we are
Input [-1:1]
                  0.5
                                                                                                                    also investigating relevant clinical requirements and potential
                   0
                                                                                                                    control strategies that would work seamlessly with the user’s
               -0.5                                                                                                 motion. The goal is to achieve a fully untethered wearable
                   -1
                                                                                                                    system to provide a new level of mobility and active assistance.
                        0      2.5    5    7.5    10   12.5    15   17.5    20     22.5    25   27.5      30        This will open a rich space for future rehabilitation techniques
                                                       Time (sec)
                                                                                                                    both inside and outside of the clinic.
(b)
                                      Square-Wave Reference (0.1 Hz; 10 )                                                While the system goals for rehabilitation—seated ankle
                12.5
                  10
                                                                                                                    motions—were achieved, the design components could be
                                                                                                                    adapted for increased performance. From an actuation
Angle (deg)
                 7.5
                   5
                 2.5                                                                                                perspective, for example, we could use higher bandwidth
                   0
                -2.5                                                                                                actuators and valves. From a control perspective, in order
                  -5                                                             Reference yd(t)
                -7.5                                                                                                to track angular positions that result from fast walking
                 -10                                                             Measured Angle y(t)                and running, more sophisticated algorithms are required. In
               -12.5
                         0      2.5    5    7.5   10    12.5   15    17.5   20      22.5   25      27.5   30
                                                        Time (sec)                                                  particular, it is possible to represent trajectories similar to the
                                                                                                                    one in figure 23 by linearly combining families of sinusoidal
                             Signal u(t) for Square-Wave Reference (0.1 Hz; 10 )                                    functions. Then, algorithms specialized in tracking families
                    1
                                                                                                                    of sinusoidal signals, like multiple-period repetitive control
                                                                                                                    [57], can be used to synthesize feedback controllers. Also, it
   Input [-1:1]
0.5
                    0
                                                                                                                    is possible to use adaptive schemes like the one in [58].
                                                                                                                         We presented a methodology for synthesizing controllers
                  -0.5
                                                                                                                    for a biologically inspired pneumatically-actuated soft orthotic
                    -1                                                                                              device. The proposed approach relied on system identification
                         0      2.5    5    7.5   10    12.5   15    17.5   20      22.5   25      27.5   30
                                                        Time (sec)
                                                                                                                    and classical LTI design tools. This is surprising and
                                                                                                                    useful, considering that the system to be controlled was
Figure 24. Sixth set of experiments. In both experimental cases,                                                    highly complex, in which electronic, mechanical, and
(a) and (b), upper plot shows the time-series of the reference signal                                               pneumatic components interact with a human body. Based
yd (t ) and the measured angular position y(t ), the controlled                                                     on experimental data, we presented evidence that by proper
variable. In both cases, the bottom plot shows the time-series of the
corresponding signal u(t ). In case (a), the reference is a 0.1                                                     choice of the inputs and outputs, classical and modern
Hz-square-wave with an amplitude of 2.5◦ . In case (b), the reference                                               system-theoretic tools can be implemented for designing high-
is a 0.1 Hz-square-wave with an amplitude of 10◦ .                                                                  performance controllers for complex systems.
                                                                                                                         In this paper, the prototype was tested for seated motions,
  (i) Bio-inspired actuation system. While most of previous                                                         which have importance for rehabilitation, as a first proof of
      ankle–foot orthotics regard an ankle joint as a simple                                                        principle. From this initial testing, we can develop a controller
      mechanical pin joint, the proposed device mimics a                                                            that can assist walking gaits. However, gait assistance is
      biological muscle—tendon–ligament architecture with                                                           beyond the scope of our current work. Also, while force
      multiple muscles to create various natural ankle motions.                                                     control may be more appropriate for assisting and supporting
 (ii) Soft strain sensors. Hyperelastic strain sensors were                                                         dynamic walking—our ultimate goal—the position control
      developed and implemented to measure joint angles. This                                                       result demonstrates the feasibility of our current prototype
      type of soft sensors makes the device easily wearable and                                                     for use in ankle rehabilitation activities that often consist
      conformable to complicated 3D body shapes.                                                                    of various types of seated motions, such as those shown in
(iii) Completely soft structure. The proposed system does not                                                       [59, 60]. These types of seated motions can be easily recorded
      contain any rigid frame structures that are easily seen in                                                    and replayed using our current device. Nevertheless, force
      other active orthoses, resulting in no constraints on the                                                     control with dynamic walking should be investigated as the
      natural degrees of freedom of the ankle joint.                                                                device is upgraded with embedded force sensors in the future.
    The current design showed that such an orthotic device                                                               The subject fully relaxed the ankle while neither
has the potential to provide active assistance for ankle                                                            intentionally assisting nor resisting the controller’s actuation
                                                                                                               15
Bioinspir. Biomim. 9 (2014) 016007                                                                                               Y-L Park et al
                                                                     16
Bioinspir. Biomim. 9 (2014) 016007                                                                                                  Y-L Park et al
[22] Shorter K A, Kogler G F, Loth E, Durfee W K                             [39] Chou C-P and Hannaford B 1996 Measurement and modeling
        and Hsiao-Wecksler E T 2011 A portable powered                               of McKibben pneumatic artificial muscles IEEE Trans.
        ankle-foot orthosis for rehabilitation J. Rehabil. Res. Dev.                 Robot. Autom. 12 90–102
        48 459–72                                                            [40] Tondu B and Lopez P 2000 Modeling and control of Mckibben
[23] Hollander K W, Ilg R, Sugar T G and Herring D 2006 An                           artificial muscle robot actuators IEEE Control Syst. Mag.
        efficient robotic tendon for gait assistance J. Biomech. Eng.                20 15–38
        128 788–92                                                           [41] Belforte G, Eula G, Appendino S and Sirolli S 2011 Pneumatic
[24] Svensson W and Holmberg U 2008 Ankle-foot-orthosis                              interactive gait rehabilitation orthosis: design and
        control in inclinations and stairs Proc. IEEE Int. Conf. on                  preliminary testing Proc. Inst. Mech. Eng. H 225 158–69
        Robotics Automation and Mechatronics (Chengdu, China)                [42] Wolbrecht E T, Chan V, Reinkensmeyer D J and Bobrow J E
        pp 301–6                                                                     2008 Optimizing compliant, model-based robotic assistance
[25] Nikitczuk J, Weinberg B, Canavan P K and Mavroidis C 2010                       to promote neurorehabilitation IEEE Trans. Neural Syst.
        Active knee rehabilitation orthotic device with variable                     Rehabil. Eng. 16 286–97
        damping characteristics implemented via an                           [43] Balasubramanian K and Rattan K S 2003 Fuzzy logic control
        electrorheological fluid IEEE/ASME Trans. Mechatronics                       of a pneumatic muscle system using a linearizing control
        15 952–60                                                                    scheme Proc. 22nd Int. Conf. North American Fuzzy
                                                                                     Information Processing Society (Chicago, IL) pp 432–6
[26] Stirling L, Yu C, Miller J, Wood R J, Goldfield E and Nagpal R
                                                                             [44] Balasubramanian K and Rattan K S 2005 Trajectory tracking
        2011 Applicability of shape memory alloy wire for an
        active, soft orthotic J. Mater. Eng. Perform. 20 658–62                      control of a pneumatic muscle system using fuzzy logic
                                                                                     Proc. Annual Meeting North American Fuzzy Information
[27] Galiana I, Hammond F L, Howe R D and Popovic M B 2012                           Processing Society (Ann Arbor, MI) pp 472–7
        Wearable soft robotic device for post-stroke shoulder                [45] Thanh T D C and Ahn K K 2006 Nonlinear PID control to
        rehabilitation: Identifying misalignments Proc. IEEE/RSJ                     improve the control performance of 2 axes pneumatic
        Int. Conf. on Intelligent Robots and Systems (Vilamoura,                     artificial muscle manipulator using neural network
        Portugal) pp 317–22                                                          Mechatronics 16 577–87
[28] Ueda J, Ming D, Krishnamoorthy V, Shinohara M                           [46] Bertetto A M and Ruggiu M 2004 Characterization and
        and Ogasawara T 2010 Individual muscle control using an                      modeling of air muscles Mec. Res. Commun. 31 185–94
        exoskeleton robot for muscle function testing IEEE Trans.            [47] Reynolds D B, Repperger D W, Phillips C A and Bandry G
        Neural Syst. Rehabil. Eng. 18 399–50                                         2003 Modeling the dynamic characteristics of pneumatic
[29] Kim S, Spenko M, Trujillo S, Heyneman B, Santos D                               muscle Ann. Biomed. Eng. 31 310–7
        and Cutkosky M R 2008 Smooth vertical surface climbing               [48] Au S K, Weber J and Herr H 2007 Biomechanical design of a
        with directional adhesion IEEE Trans. Robot. 24 65–74                        powered ankle–foot prosthesis Proc. IEEE 10th Int. Conf.
[30] Park Y-L, Majidi C, Kramer R, Berard P and Wood R J 2010                        on Rehabilitation Robotics pp 298–303
        Hyperelastic pressure sensing with a liquid-embedded                 [49] Au S K, Weber J and Herr H 2009 Powered ankle–foot
        elastomer J. Micromech. Microeng. 20 125029                                  prosthesis improves walking metabolic economy IEEE
[31] Park Y-L, Chen B, Majidi C, Wood R J, Nagpal R                                  Trans. Robot. 25 51–66
        and Goldfield E 2012 Active modular elastomer sleeve for             [50] Eilenberg M F, Geyer H and Herr H 2010 Control of a
        soft wearable assistance robots Proc. IEEE/RSJ Int. Conf.                    powered ankle-foot prosthesis based on a neuromuscular
        on Intelligent Robots and Systems (Vilamoura, Portugal) pp                   model IEEE Trans. Neural Syst. Rehabil. Eng. 18 164–73
        1595–602                                                             [51] Cho Y M, Xu G and Kailath T 1994 Fast identification of
[32] Park Y-L, Chen B and Wood R J 2012 Design and                                   state-space models via exploitation of displacement
        manufacturing of soft artificial skin using embedded                         structure IEEE Trans. Autom. Control 39 2004–17
        microchannels and liquid conductors IEEE Sensors J.                  [52] Pérez Arancibia N O, Gibson S and Tsao T-C 2004 Adaptive
        12 2711–8                                                                    control of MEMS mirrors for beam steering Proc. ASME
[33] Slabaugh G 1999 Computing Euler angles from a rotation                          Int. Mechanical Engineering Congress and Exposition
        matrix Technical Report City University London                               (Anaheim, CA) p 60256
        www.soi.city.ac.uk/∼sbbh653/publications/euler.pdf                   [53] Ljung L 1999 System Identification (Upper Saddle River, NJ:
[34] Mengüc Y, Park Y-L, Martinez-Villalpando E, Aubin P,                           Prentice-Hall)
        Zisook M, Stirling L, Wood R J and Walsh C J 2013 Soft               [54] Van Overschee P and De Moor B 1996 Subspace Identification
        wearable motion sensing suit for lower limb biomechanics                     for Linear Systems (Norwell, MA: Kluwer)
        measurements Proc. IEEE Int. Conf. on Robotics and                   [55] Rose J and Gamble J G 2006 Human Walking (Philadelphia,
        Automation (Karlsruhe, Germany) pp 5289–96                                   PA: Lippincott Williams & Wilkins)
                                                                             [56] Dullerud G E and Paganini F 2000 A Course in Robust Control
[35] Shin D, Sardellitti I, Park Y-L, Khatib O and Cutkosky M 2010
                                                                                     Theory (New York: Springer)
        Design and control of a bio-inspired human-friendly robot
                                                                             [57] Pérez-Arancibia N O, Tsao T-C and Gibson J S 2010 A new
        Int. J. Robot. Res. 29 571–84
                                                                                     method for synthesizing multiple-period adaptive-repetitive
[36] Jien S, Hirai S, Ogawa Y, Ito M and Honda K 2009 Pressure                       controllers and its application to the control of hard disk
        control valve for Mckibben artificial muscle actuators with                  drives Automatica 46 1186–95
        miniaturized unconstrained pneumatic on/off valves Proc.             [58] Sacks A, Bodson M and Khosla P 1996 Experimental results
        IEEE/ASME Int. Conf. on Advanced Intelligent                                 of adaptive periodic disturbance cancellation in a high
        Mechatronics (Singapore) pp 1383–8                                           performance magnetic disk drive ASME J. Dyn. Syst. Meas.
[37] Kerscher T, Zoellner J M, Dillmann R, Stella A                                  Control 118 416–24
        and Caporaletti G 2006 Model and control of joints driven            [59] Connelly D M and Vandervoort A A 2000 Effects of isokinetic
        by fluidic muscles with the help of advanced automatic                       strength training on concentric and eccentric torque
        algorithm generation software Climbing Walking Robots                        development in the ankle dorsiflexors of older adults
        4 245–52                                                                     J. Gerontol. A Biol. Sci. Med. Sci. 55 B465–72
[38] Wolbrecht E T, Leavitt J, Reinkensmeyer D J and Bobrow J E              [60] Fowler E G, Ho T W, Nwigwe A I and Dorey F J 2001 The
        2006 Control of a pneumatic orthosis for upper extremity                     effect of quadriceps femoris muscle strengthening exercises
        stroke rehabilitation Proc. 28th IEEE EMBS Annual Int.                       on spasticity in children with cerebral palsy Phys. Ther.
        Conf. (New York, NY) pp 2687–93                                              81 1215–23
17