Design of Autonomous Gel Actuators

In this paper, we introduce autonomous gel actuators driven by chemical energy. The polymer gels prepared here have cyclic chemical reaction networks. With a cyclic reaction, the polymer gels generate periodical motion. The periodic motion of the gel is produced by the chemical energy of the oscillatory Belouzov-Zhabotinsky (BZ) reaction. We have succeeded in making synthetic polymer gel move autonomously like a living organism. This experimental fact represents the great possibility of the chemical robot.


Introduction
Gels have cross-linked networked structures of polymer chains containing solvents; and these gels that swell or shrink due to environmental changes have been studied in various fields [1][2][3][4][5].Recently, soft robots [6,7] made of electro-active polymer gel [8] have been developed.These gel robots do not need mechanical parts such as motors, drive shafts, gears, etc. because the driving mechanism of the soft robots is different from that of classical mechanical machines.In previous decades, Kachalsky et al. have

OPEN ACCESS
demonstrated an energy conversion system transforming chemical energy into mechanical energy using collagen fibers [8].Also, since volume phase transition of polymer gels was found [9], many kinds of applications such as a drug delivery system [10], robotic hands [11], and matter transporting device [12], have been studied.The phase transition of polymer gel is induced by hydrogen bonds, coulomb, hydrophobic, and van der Waals interactions.Hence, these devices can operate by controlling external conditions.For example, the poly(N-isopropylacrylamide) (PNIPAAm) is known to undergo a discontinuous volume change on volume change in temperature.In application, dynamic actuation systems by integrating high-aspect-ratio silicon nanocolumns with the PNIPAAm gel have been demonstrated [13].But, these systems require the complex and fabricated circuit or external control devices because the motion of the polymer gel is driven by external physicochemical signals.On the other hand, in biological systems, there are several autonomous phenomena exhibiting spontaneous motion such as peristaltic motion, heartbeat, brain waves, etc.If such a system is achieved in an artificial system, a novel robot which does not need external control would be expected.However, there are some studies on creating autonomous systems by using chemical energy.Biohybrid actuators from engineered tissue and synthetic polymer thin films have been demonstrated [14].Although utilization of biopolymer or cell system is one method, our strategy is completely an artificial system.
In this review, we introduce active polymer gel actuators.Gels exhibit a unique capability of undergoing spontaneous volume changes in response to oscillatory chemical reaction.For example, gels can undergo rhythmic swelling and shrinking in response to variations in the pH of the surrounding solution caused by an oscillating reaction.The pH oscillations were generated by the Landolt reaction [15] or by an enzymatic reaction [16].Periodical volume changes were also observed in a pH responsive gel, which exhibited bistability with diffusion of a reactive substrate into the gel [17].The chemical reactions were carried out under nonequilibrium conditions provided by precisely controlled continuous-flow stirred tank reactors (CSTR) [15,17].This means that the condition around the gel is not stationary.From the point of view of engineering, the stationary conditions around the gel are acceptable.So, we focused on the Belousov-Zhabotinsky (BZ) reaction [18].The BZ reaction is widely known as a chemical oscillating reaction and reaction diffusion system.The overall process is the oxidation of an organic substrate by an oxidizing agent in the presence of a metal catalyst under acidic conditions.Metal ions or metal complexes with high redox potentials, such as cerium ion, ferroin, or ruthenium tris(2,2'-bipyridine) are widely used as catalysts.In the reaction processes, the metal ion periodically changes its charge number to oscillate between the oxidized and reduced states for several hours, as long as the substrate exists.In an unstirred solution, there are chemical waves and spatial pattern formations in the reaction processes.Researchers have developed the mixed system between the polymer and BZ reaction.The use of the polymer gels in the BZ reaction has so far been confined to eliminating hydrodynamic convection disturbing reaction diffusion patterns [19] and localizing the BZ reaction in a restricted region [20].In these systems, the structure of the polymer does not change by the BZ reaction because the interaction between the gel structure and the reaction diffusion system is negligibly small.It was reported that polymers and gels undergo a slight spontaneous structure change [21][22][23].In the oscillating gel systems, the polymer network itself takes part in the BZ reaction, because the metal catalyst is covalently bounded to the polymer chain.As a result, the reaction medium can change in time and space.In other words, the BZ reaction causes the structural changes of the polymer.When the redox state of the metal catalyst moiety in the gel changed, the solubility of the polymer chain changed as well.As a result, the change in the osmotic pressure inside the gel causes the swelling or shrinking of the polymer gel.The displacement of the self-oscillating gel is several dozen micrometers [23].However, the mechanical displacement of the gel was too small to design the gel actuator.Therefore, in order to construct gel actuators, we should greatly improve displacement of the gel.

Design of Self-Walking Gel
To create the large deformation of the gel, we introduced a gradient structure into the oscillating gel.To make the gradient structure in the gel, we used the hydrophobic interaction between the Ru(bpy) 3 2+ moiety and casting mold during polymerization.As a result, a large periodical deformation of the gel coupled with the BZ reaction was achieved [24].During polymerization, the monomer solution faces two different surfaces of plates: A hydrophilic glass surface and a hydrophobic Teflon surface.Since the Ru(bpy) 3 2+ monomer is hydrophobic, it is easy to migrate to the Teflon surface side.As a result, a uniform distribution in the direction of the thickness is formed for the component, and the resulting gel has gradient distribution for the content of each component in the polymer network.Thus, the hydrophilic 2-acrylamide-2-methylpropane sulfonic acid (AMPS) component at the glass side was higher than that at the Teflon side.In contrast, the hydrophobic Ru(bpy) 3 2+ moiety at the Teflon side was higher than that at the glass side.Therefore, as for the gel at the AMPS rich side, the swelling ratio was higher than that of the opposite side (i.e., the Ru(bpy) 3 2+ rich side).Consequently the gel in water bends to the direction of the surface which was faced to the Teflon plate during polymerization.The curvature in the oxidized state was larger than that in the reduced state over the full temperature range.This is because when the hydrophilicity of the polymer increases, the gel expands in the oxidized state.From the deviation of the curvature in the Ru(II) and the Ru(III) states, we expected that the gel caused the periodical bending-stretching motion induced by the BZ reaction at constant temperatures.Figure 1(a) shows the periodical changes of gel motion in the aqueous solution containing the three reactants of the BZ reaction (malonic acid, sodium bromate and nitric acid) at constant temperatures.The chemical wave evolves in the gel, and it propagates in the direction of the length at constant speed from one edge, attaching the substrate to the other edge.With the propagation of the chemical wave, the distance between the two edges of the gel changes periodically because a spontaneous bending and stretching motion occurs (Figure 1(b)).While the chemical wave exists in the gel (1→4), the gel stretches.After that, during the reduced state until the next wave appears (4→1), the gel bends.As shown in Figure 1(c), the displacement of the mechanical oscillation (Δl max ) changes with temperature because the difference in swelling ratio between reduced state and oxidized state depends on temperature.We can see that there is an optimum temperature (18 °C) at which the amplitude becomes the maximum.To convert the bending and stretching changes to the vectorial work, we applied a ratchet mechanism to our gel system.We prepared the ratchet floor with an asymmetrical surface structure as shown in Figure 2(a).On the ratchet floor, the gel repeats bending and stretching autonomously, but sliding backwards is prevented by the teeth of the ratchet.As a result, the gel could move forward.Figure 2(b) shows successive profiles of the "self-walking" motion of the gel in the BZ reaction [25].The period of chemical oscillation was about 112 s, and the walking velocity of the gel actuator was about 170 μm/min.

Design of Peristaltic Motion of Polymer Gel
Next, we tried to create the peristaltic motion coupled with the chemical wave directly.In previous work, however, it was difficult to observe the peristaltic motion coupled with the chemical wave directly because the mechanical oscillation was too small in comparison to the gel size.Theoretical studies have predicted the occurrence of peristaltic motion within the gel [26,27].Most recently, we first succeeded in observing the peristaltic motion of the gel [28] directly by utilizing a novel gel with a porous structure.We focus on the kinetics of the polymer gel.The network motion of the gel as given by Tanaka, Hocker and Benedek [29] is where Δ denotes the Laplacian and ) , ( t r u   is the displacement vector that represents the displacement of a point in the network.K, μ and f are the osmotic bulk modulus, shear modulus of polymer gel and friction coefficient between network and fluid medium, respectively.In the case of a radial deformation (1) becomes D c is the diffusion coefficient of the polymer gel.If the D c is high value, the response of the gel is fast as shown in Equation ( 2).In general, the degree of the response of hydro gels composed of chemically cross-linked polymer networks is low because the polymer chains are molecularly restricted by a large number of cross-links.There are remarkable differences in the swelling ratio between the reduced Ru(II) state and oxidized Ru(III) state in the poly(NIPAAm-co-Ru(bpy) 3 ) gel at the equilibrium swelling state.Actually, the volume oscillation coupled with the redox oscillation of the ruthenium catalyst moiety due to the BZ reaction is very small.The rate of the redox reaction of the Ru moiety is significantly faster than that of the swelling-deswelling of the gel in the equilibrium condition such as mentioned above.Therefore, the poly(NIPAAm-co-Ru(bpy) 3 ) self-oscillating gel generated a small mechanical oscillation.In order to produce a large mechanical oscillation in comparison with the gel size, the self-oscillating gel has to first respond to the rate of the BZ reaction.In order to achieve this, we prepared a microphase-separated self-oscillating gel.This was done because in previous work it was reported that the NIPAAm gel with micro scale phase separation underwent quick response [30].By preparing NIPAAm gel above the lower critical temperature (LCST), the network structure becomes inhomogeneous due to the LCST nature of the NIPAAm component.As a result, the NIPAAm gel forms a porous structure that consists of two regions: polymer rich domains, and the other is aggregations in the matrix of loosely tied network structure.Consequently, rich domains inside the gel clump or loosen rapidly because of an effluent pathway of water due to the porous structure as shown in Figure 3.However, the micro phase separation in the gel strongly depends on the methods and ways of gel preparation.Therefore, control of the phase separation was too difficult by selecting the synthesis temperature.In order to control the micro scale phase separation into the self-oscillating gel, we synthesized the gel under the water-methanol mixture solution by utilizing the hydrophobic casting mold.Generally, in the mixed solvent of water and methanol, the LCST of aqueous PNIPAAm solutions shifts to lower temperature [31,32].So, it is assumed that the micro phase separated structure was introduced inside the gel.As shown in Figure 4, the swelling speed of the microphase-separated self-oscillating gel was faster than that of the poly(NIPAAm-co-Ru(bpy) 3 ) gel at 18 °C.This result indicated that the swelling dynamics of the microphase-separated self-oscillating gel is different from the poly(NIPAAm-co-Ru(bpy) 3 ) gel.The data supported that the time scale of the swelling kinetics and the chemical reaction matched.This result is significantly important causing a large deformation of the gel by utilizing the BZ reaction.Next, we prepared cubic gel smaller than the wavelength of the chemical wave.Within the miniature gel, the redox change homogeneously occurred without evolution of chemical waves.As for the miniature gel, oscillating profiles of the redox changes, as well as the swelling-deswelling changes, were analyzed by using the image-processing method.Figure 5 shows the self-oscillating behavior of the cubic gel in the aqueous solution containing the three reactants of the BZ reaction (malonic acid, sodium bromate and nitric acid) at constant temperature.The displacement of the mechanical oscillation was around 130 μm.The displacement of the volume oscillation for the microphase-separated self-oscillating gel is about ten times as large as that for the poly(NIPAAm-co-Ru(bpy) 3 ) gel.This result indicated that the large mechanical oscillation of the gel required the rapid response to the change in the redox state of the metal catalyst induced by the BZ reaction.From this result, it is expected that gel which is larger than the wavelength of the chemical wave undergoes periodical peristaltic motion when the redox state of the Ru(bpy) 3 moiety in the gel periodically change by the BZ reaction at the constant temperature.Figure 6 shows the periodical peristaltic motion of the gel driven by the chemical waves of the BZ reaction.We succeeded in directly observing the periodical peristaltic motion of the gel.With the propagation of the chemical waves, the local swelling regions propagated in the gel.This is the first visual evidence of the peristaltic motion of the gel in the macroscopic scale.The shape change of the gel was in excellent agreement with the theory [26,27].The aspects of the volume change of the gel followed the reaction diffusion dynamics.The chemical wave speed of the BZ reaction was approximately 14.0-30.0μm/s in the gel.

Matter transport
Furthermore, we succeeded in conveying the object by utilizing the peristaltic motion of the gel.We set the cylindrical polyacrylamide gel as the object on the rectangular microphase-separated self-oscillating gel in the aqueous solution containing the three reactants of the BZ reaction.Figure 7 illustrates matter transport.The peristaltic surface of the gel pushed and carried the object by rotating it in one direction at about 40 μm/sec by the chemical wave propagation.The gel conveyer carried the object autonomously with millimeter order.It is assumed that the peristaltic motion of the gel can be controlled by changing the concentration of the BZ substrates because the spatiotemporal dynamic pattern changes with changing the outer solution.

Control of Autonomous Swelling-Deswelling Behavior of a Polymer Gel
The conventional oscillating gel shrinks at temperatures above the LCST (lower critical solution temperature) because oscillating gel has the thermo sensitive PNIPAAm chain.To realize high-speed driving, we attempted to synthesize a novel self-oscillating polymer gel that drives without temperature limitation.In this study, we selected a non-thermo sensitive and biocompatible poly(vinylpyrrolidone) (PVP) as the polymer main chain of the novel self-oscillating gel (poly(VP-co-Ru(bpy) 3 gel)) [33].As a result, we first succeeded in causing volume oscillation at a high temperature condition.We studied the influence of the initial concentration of the three BZ substrates other than the metal catalyst and the temperature during the period of self-oscillation as the gel can be controlled by the selection of the initial concentration of the three BZ substrates (malonic acid, sodium bromate, and nitric acid) and the temperature.Moreover, by optimizing the initial concentration of the BZ substrates and the temperature, we succeeded in causing the volume oscillation with frequencies 0.5 Hz.This frequency (0.5 Hz) of the novel gel was 20 times as large as that of the conventional-type self-oscillating gel (poly(NIPAAmco-Ru(bpy) 3 gel).We expect that this novel oscillating polymer system will lead to a wide range of applications.
Figure 8 shows the equilibrium swelling behavior of the poly(VP-co-Ru(bpy) 3 ) gels in the Ce(III) and Ce(IV) solutions under the same acidic conditions.In the Ce(III) solution, the gel kept a tinge of orange, which indicated that the copolymerized Ru(bpy) 3 moiety in the gel was in the reduced state.On the other hand, in the Ce(IV) solution, the gel quickly turned from orange to green, which showed the Ru(bpy) 3 moiety in the gel changed the oxidized state from the reduced state.In the oxidized state, the equilibrium volume of the gel was greater than that in the reduced state in all temperature conditions.This is because the solubility of the Ru(bpy) 3 moiety has significantly different properties in the oxidized and the reduced states.In the reduced and the oxidized states, there is no observation of the volume phase transition due to the PVP main chain of the gel without LCST.The relative length is defined as the ratio of characteristic diameter at the initial state at 20 °C.Reprinted from Ref. [33] with permission; © The American Chemical Society.Furthermore, as shown in Figure 9, the period of the swelling-deswelling self-oscillation decreased with increasing the temperature because the temperature affects the BZ reaction rate in accordance with the Arrenius equation [34].The maximum frequency (0.5 Hz) of the poly(VP-co-Ru(bpy) 3 ) gel was 20 times as large as that of poly(NIPAAm-co-Ru(bpy) 3 gel [23].The self-oscillating behavior of the poly(Vp-co-Ru(bpy) 3 ) gel at 20 °C and 50 °C is shown in Figure 9(b) and 9(c), respectively.The displacement of the volume change self-oscillation at 20 °C and 50 °C were about 10 μm and 4 μm, respectively.These results clarified that the displacement of the swelling-deswelling self-oscillation of the gel has a trade-off relationship with the period of self-oscillation; that is, the length of the volume change decreased on increasing the period.Therefore, we are investigating a corrective strategy for the trade-off relationship between the period of self-oscillation and the displacement of the gel, in order to realize autonomous soft actuators that cause the large deformation at a high speed.

Conclusion
In this paper, we introduced novel autonomous polymer gel actuators driven by chemical energy.We consider autonomous gel actuators to be the preliminary step for "Chemical Robotics".Chemical robots differ from mechanical robots in terms of assembly, material, driving force, etc.At the present stage, an operating condition for the walking motion is limited to one dimension.Our next work is will develop various gel motions caused by the reaction diffusion system.

Figure 3 .
Figure 3. Illustration of the porous gel.

Figure 6 .
Figure 6.Time course of peristaltic motion of microphase-separated self-oscillating gel in 8 mL of the mixture solution of the BZ substrates (62.5 mM malonic acid, 84 mM sodium bromate, 0.894 M nitric acid, 18 °C).The green and orange colors correspond to the oxidized and reduced state of Ru moiety in the gel, respectively.S. Maeda et al.Peristaltic motion of polymer gels.Angew.Chem.Int.Ed. 2008, 47, 6690-6693.Copyright Wiley-VCH Verlag GmbH & Co.KGaA.Reproduced with permission.