Design of 3D Controller Using Nanocracking Structure-Based Stretchable Strain Sensor
<p>Overall schematic of 3D controller system. (<b>a</b>) The overall composition is divided into flexible body, OPSS sensor, and micro controller unit. (<b>b</b>) Flexible OPSS sensor (<b>c</b>) SEM image of pre-strained OPSS sensor.</p> "> Figure 2
<p>Numerical analysis of 3D deformation caused by the multi-axis motion of the designed flexible body. The blue highlighted regions indicated the regions where we applied (<b>a</b>) fixed constraint and (<b>b</b>) external body load boundary conditions. (<b>c</b>–<b>e</b>) represent the magnitudes of Y-axis normal strain (ε<sub>yy</sub>) under the X-, Y-, and Z-axis body load conditions (at 0.01 N), respectively. The black solid lines in (<b>c</b>–<b>e</b>) represent the original location of the flexible body before deformation.</p> "> Figure 3
<p>Resistance change of each sensor measured when moved in (<b>a</b>) X-, (<b>b</b>) Y-, and (<b>c</b>) Z-axes.</p> "> Figure 4
<p>Single-axis strain measurement test and data visualization. Motions on (<b>a</b>) XY plane and along (<b>b</b>) Z-axis.</p> "> Figure 5
<p>Resistance change of sensor and two rest resistance in front and back motion; the blue and red dotted lines represent the tension and contraction phases, respectively.</p> "> Figure 6
<p>Position comparison using sensor recognition system and position prediction using sensor. (<b>a</b>) Motion recognition by Leap Motion when 3D controller has front and back motion (<b>b</b>) Comparison of front-back motion predicted through machine learning and sensors and Leap Motion position tracking.</p> "> Figure 7
<p>Position comparison using sensor recognition system and position prediction using sensor after changing the learning range.</p> ">
Abstract
:1. Introduction
2. Design and Methods
2.1. 3D Controller Fabrication
2.2. Numerical Analysis of Deformation of the Flexible Body
2.3. Machine Learning Based Estimation of 3D Controller Position
3. Results and Discussion
3.1. Independent Resistance Change Measurement for Each Axis and Visualization
3.2. Compensation of Limitations of Polymers through Data Learning
4. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Liao, M.; Wan, P.; Wen, J.; Gong, M.; Wu, X.; Wang, Y.; Shi, R.; Zhang, L. Wearable, Healable, and Adhesive Epidermal Sensors Assembled from Mussel-Inspired Conductive Hybrid Hydrogel Framework. Adv. Funct. Mater. 2017, 27, 1703852. [Google Scholar] [CrossRef]
- Qu, J.; Zhao, X.; Ma, P.X.; Guo, B. Injectable Antibacterial Conductive Hydrogels with Dual Response to an Electric Field and PH for Localized “Smart” Drug Release. Acta Biomater. 2018, 72, 55–69. [Google Scholar] [CrossRef]
- Guo, B.; Qu, J.; Zhao, X.; Zhang, M. Degradable Conductive Self-Healing Hydrogels Based on Dextran-Graft-Tetraaniline and N-Carboxyethyl Chitosan as Injectable Carriers for Myoblast Cell Therapy and Muscle Regeneration. Acta Biomater. 2019, 84, 180–193. [Google Scholar] [CrossRef] [PubMed]
- Shi, Q.; Zhang, Z.; Yang, Y.; Shan, X.; Salam, B.; Lee, C. Artificial Intelligence of Things (AIoT) Enabled Floor Monitoring System for Smart Home Applications. ACS Nano 2021, 15, 18312–18326. [Google Scholar] [CrossRef]
- Lee, H.J.; Baik, S.; Hwang, G.W.; Song, J.H.; Kim, D.W.; Park, B.; Min, H.; Kim, J.K.; Koh, J.; Yang, T.-H.; et al. An Electronically Perceptive Bioinspired Soft Wet-Adhesion Actuator with Carbon Nanotube-Based Strain Sensors. ACS Nano 2021, 15, 14137–14148. [Google Scholar] [CrossRef] [PubMed]
- Wu, Y.; Qu, J.; Zhang, X.; AO, K.; Zhou, Z.; Zheng, Z.; Mu, Y.; Wu, X.; Luo, Y.; Feng, S.-P. Biomechanical Energy Harvesters Based on Ionic Conductive Organohydrogels via the Hofmeister Effect and Electrostatic Interaction. ACS Nano 2021, 15, 13427–13435. [Google Scholar] [CrossRef] [PubMed]
- Zhou, Z.; Weng, L.; Tat, T.; Libanori, A.; Lin, Z.; Ge, L.; Yang, J.; Chen, J. Smart Insole for Robust Wearable Biomechanical Energy Harvesting in Harsh Environments. ACS Nano 2020, 14, 14126–14133. [Google Scholar] [CrossRef]
- Qin, Y.; Qiu, C.; Hu, Y.; Ge, S.; Wang, J.; Jin, Z. In Situ Self-Assembly of Nanoparticles into Waxberry-Like Starch Microspheres Enhanced the Mechanical Strength, Fatigue Resistance, and Adhesiveness of Hydrogels. ACS Appl. Mater. Interfaces 2020, 12, 46609–46620. [Google Scholar] [CrossRef]
- Dong, B.; Yang, Y.; Shi, Q.; Xu, S.; Sun, Z.; Zhu, S.; Zhang, Z.; Kwong, D.-L.; Zhou, G.; Ang, K.-W.; et al. Wearable Triboelectric–Human–Machine Interface (THMI) Using Robust Nanophotonic Readout. ACS Nano 2020, 14, 8915–8930. [Google Scholar] [CrossRef]
- Chen, T.; Zhao, M.; Shi, Q.; Yang, Z.; Liu, H.; Sun, L.; Ouyang, J.; Lee, C. Novel Augmented Reality Interface Using a Self-Powered Triboelectric Based Virtual Reality 3D-Control Sensor. Nano Energy 2018, 51, 162–172. [Google Scholar] [CrossRef]
- Liagkou, V.; Salmas, D.; Stylios, C. Realizing Virtual Reality Learning Environment for Industry 4.0. Procedia CIRP 2019, 79, 712–717. [Google Scholar] [CrossRef]
- Adikari, S.B.; Ganegoda, N.C.; Meegama, R.G.N.; Wanniarachchi, I.L. Applicability of a Single Depth Sensor in Real-Time 3D Clothes Simulation: Augmented Reality Virtual Dressing Room Using Kinect Sensor. Adv. Hum. Comput. Interact. 2020, 2020, 1314598. [Google Scholar] [CrossRef]
- Ayoub, A.; Pulijala, Y. The Application of Virtual Reality and Augmented Reality in Oral & Maxillofacial Surgery. BMC Oral. Health 2019, 19, 238. [Google Scholar] [CrossRef]
- Sergiyenko, O.Y.; Tyrsa, V.V. 3D Optical Machine Vision Sensors With Intelligent Data Management for Robotic Swarm Navigation Improvement. IEEE Sens. J. 2021, 21, 11262–11274. [Google Scholar] [CrossRef]
- Guo, H.; Wan, J.; Wu, H.; Wang, H.; Miao, L.; Song, Y.; Chen, H.; Han, M.; Zhang, H. Self-Powered Multifunctional Electronic Skin for a Smart Anti-Counterfeiting Signature System. ACS Appl. Mater. Interfaces 2020, 12, 22357–22364. [Google Scholar] [CrossRef] [PubMed]
- Uz, M.; Lentner, M.T.; Jackson, K.; Donta, M.S.; Jung, J.; Hondred, J.; Mach, E.; Claussen, J.; Mallapragada, S.K. Fabrication of Two-Dimensional and Three-Dimensional High-Resolution Binder-Free Graphene Circuits Using a Microfluidic Approach for Sensor Applications. ACS Appl. Mater. Interfaces 2020, 12, 13529–13539. [Google Scholar] [CrossRef]
- Chen, Y.; Pu, X.; Liu, M.; Kuang, S.; Zhang, P.; Hua, Q.; Cong, Z.; Guo, W.; Hu, W.; Wang, Z.L. Shape-Adaptive, Self-Healable Triboelectric Nanogenerator with Enhanced Performances by Soft Solid–Solid Contact Electrification. ACS Nano 2019, 13, 8936–8945. [Google Scholar] [CrossRef] [PubMed]
- Sarkar, P.K.; Kamilya, T.; Acharya, S. Introduction of Triboelectric Positive Bioplastic for Powering Portable Electronics and Self-Powered Gait Sensor. ACS Appl. Energy Mater. 2019, 2, 5507–5514. [Google Scholar] [CrossRef]
- Seo, B.; Cha, Y.; Choi, Y.; Kim, S.; Choi, W. Rationally Designed Micropixelation-Free Tactile Sensors via Contour Profile of Triboelectric Field Propagation. Nano Energy 2023, 109, 108255. [Google Scholar] [CrossRef]
- Prasad, G.; Graham, S.A.; Yu, J.S.; Kim, H.; Lee, D.-W. Investigated a PLL Surface-Modified Nylon 11 Electrospun as a Highly Tribo-Positive Frictional Layer to Enhance Output Performance of Triboelectric Nanogenerators and Self-Powered Wearable Sensors. Nano Energy 2023, 108, 108178. [Google Scholar] [CrossRef]
- Shen, X.; Zhao, D.; Xie, Y.; Wang, Q.; Shamshina, J.L.; Rogers, R.D.; Sun, Q. Cellulose Gel Mechanoreceptors—Principles, Applications and Prospects. Adv. Funct. Mater. 2023, 33, 2214317. [Google Scholar] [CrossRef]
- Yang, P.; Shi, Y.; Tao, X.; Liu, Z.; Li, S.; Chen, X.; Wang, Z. Self-powered Virtual Olfactory Generation System Based on Bionic Fibrous Membrane and Electrostatic Field Accelerated Evaporation. EcoMat 2022, 5, e12298. [Google Scholar] [CrossRef]
- Xu, J.; Pan, J.; Cui, T.; Zhang, S.; Yang, Y.; Ren, T.-L. Recent Progress of Tactile and Force Sensors for Human–Machine Interaction. Sensors 2023, 23, 1868. [Google Scholar] [CrossRef] [PubMed]
- Mehta, D.; Rhodin, H.; Casas, D.; Fua, P.; Sotnychenko, O.; Xu, W.; Theobalt, C. Monocular 3D Human. Pose Estimation in the Wild Using Improved CNN Supervision. In Proceedings of the 5th International Conference on 3D Vision, 3DV 2017, Qingdao, China, 10–12 October 2017; pp. 506–516. [Google Scholar]
- Mehta, D.; Sridhar, S.; Sotnychenko, O.; Rhodin, H.; Shafiei, M.; Seidel, H.P.; Xu, W.; Casas, D.; Theobalt, C. VNect: Real-Time 3D Human Pose Estimation with a Single RGB Camera. ACM Trans. Graph. 2017, 36, 4. [Google Scholar] [CrossRef]
- Pavlakos, G.; Zhou, X.; Derpanis, K.G.; Daniilidis, K. Harvesting Multiple Views for Marker-Less 3D Human Pose Annotations. In Proceedings of the Proceedings—30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, 21–26 July 2016. Volume 2017-January. [Google Scholar]
- Rhodin, H.; Robertini, N.; Richardt, C.; Seidel, H.-P.; Theobalt, C. A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 7–13 December 2015; pp. 765–773. [Google Scholar]
- Simon, T.; Joo, H.; Matthews, I.; Sheikh, Y. Hand Keypoint Detection in Single Images Using Multiview Bootstrapping. In Proceedings of the Proceedings—30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, 21–26 July 2016; Volume 2017. [Google Scholar]
- Yamada, T.; Hayamizu, Y.; Yamamoto, Y.; Yomogida, Y.; Izadi-Najafabadi, A.; Futaba, D.N.; Hata, K. A Stretchable Carbon Nanotube Strain Sensor for Human-Motion Detection. Nat. Nanotechnol. 2011, 6, 296–301. [Google Scholar] [CrossRef]
- Pu, X.; Li, L.; Song, H.; Du, C.; Zhao, Z.; Jiang, C.; Cao, G.; Hu, W.; Wang, Z.L. A Self-Charging Power Unit by Integration of a Textile Triboelectric Nanogenerator and a Flexible Lithium-Ion Battery for Wearable Electronics. Adv. Mater. 2015, 27, 2472–2478. [Google Scholar] [CrossRef]
- Rogers, J.A.; Someya, T.; Huang, Y. Materials and Mechanics for Stretchable Electronics. Science 2010, 327, 1603–1607. [Google Scholar] [CrossRef] [PubMed]
- Kim, Y.; Zhu, J.; Yeom, B.; Di Prima, M.; Su, X.; Kim, J.G.; Yoo, S.J.; Uher, C.; Kotov, N.A. Stretchable Nanoparticle Conductors with Self-Organized Conductive Pathways. Nature 2013, 500, 59–63. [Google Scholar] [CrossRef]
- Trung, T.Q.; Ramasundaram, S.; Hwang, B.U.; Lee, N.E. An All-Elastomeric Transparent and Stretchable Temperature Sensor for Body-Attachable Wearable Electronics. Adv. Mater. 2016, 28, 502–509. [Google Scholar] [CrossRef]
- Wang, Y.; Wang, L.; Yang, T.; Li, X.; Zang, X.; Zhu, M.; Wang, K.; Wu, D.; Zhu, H. Wearable and Highly Sensitive Graphene Strain Sensors for Human Motion Monitoring. Adv. Funct. Mater. 2014, 24, 4666–4670. [Google Scholar] [CrossRef]
- Schwartz, G.; Tee, B.C.K.; Mei, J.; Appleton, A.L.; Kim, D.H.; Wang, H.; Bao, Z. Flexible Polymer Transistors with High Pressure Sensitivity for Application in Electronic Skin and Health Monitoring. Nat. Commun. 2013, 4, 1858–1859. [Google Scholar] [CrossRef]
- Jeon, H.; Hong, S.K.; Kim, M.S.; Cho, S.J.; Lim, G. Omni-Purpose Stretchable Strain Sensor Based on a Highly Dense Nanocracking Structure for Whole-Body Motion Monitoring. ACS Appl. Mater. Interfaces 2017, 9, 41712–41721. [Google Scholar] [CrossRef] [PubMed]
- Hong, S.; Yang, S.; Cho, S.; Jeon, H.; Lim, G. Development of a Waterproof Crack-Based Stretchable Strain Sensor Based on PDMS Shielding. Sensors 2018, 18, 1171. [Google Scholar] [CrossRef]
- Jeon, H.; Kim, M.S.; Hong, S.K.; Cho, S.J.; Lim, G. Tensile Strain-Controlled Drug Delivery System Based on a Cracked Metal Structure. Sens. Actuators B Chem. 2018, 270, 64–71. [Google Scholar] [CrossRef]
- Yang, S.; Kim, S.; Hong, S.K.; Jeon, H.; Cho, S.J.; Lim, G. Three-Axis Tension-Measuring Vitreoretinal Forceps Using Strain Sensor for Corneal Surgery. Polymers 2021, 13, 4433. [Google Scholar] [CrossRef] [PubMed]
- Hagan, M.T.; Menhaj, M.B. Training Feedforward Networks with the Marquardt Algorithm. IEEE Trans. Neural Netw. 1994, 5, 989–993. [Google Scholar] [CrossRef] [PubMed]
- Cheneler, D. Introduction to Polymer Viscoelasticity (3rd Edition). Appl. Rheol. 2007, 17, 10–11. [Google Scholar] [CrossRef]
- Gholami, M.; Ejupi, A.; Rezaei, A.; Ferrone, A.; Menon, C. Estimation of Knee Joint Angle Using a Fabric-Based Strain Sensor and Machine Learning: A Preliminary Investigation. Proc. IEEE RAS EMBS Int. Conf. Biomed. Robot. Biomechatronics 2018, 2018, 589–594. [Google Scholar] [CrossRef]
- Song, X.; Liu, X.; Peng, Y.; Xu, Z.; Liu, W.; Pang, K.; Wang, J.; Zhong, L.; Yang, Q.; Meng, J. A Graphene-Coated Silk-Spandex Fabric Strain Sensor for Human Movement Monitoring and Recognition. Nanotechnology 2021, 32, 215501. [Google Scholar] [CrossRef]
- Yoo, H.; Kim, E.; Chung, J.W.; Cho, H.; Jeong, S.; Kim, H.; Jang, D.; Kim, H.; Yoon, J.; Lee, G.H.; et al. Silent Speech Recognition with Strain Sensors and Deep Learning Analysis of Directional Facial Muscle Movement. ACS Appl. Mater. Interfaces 2022, 14, 54157–54169. [Google Scholar] [CrossRef]
- Gers, F.A.; Schmidhuber, J.; Cummins, F. Learning to Forget: Continual Prediction with LSTM. Neural Comput. 2000, 12, 2451–2471. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yang, S.; Kim, M.; Hong, S.K.; Kim, S.; Chung, W.K.; Lim, G.; Jeon, H. Design of 3D Controller Using Nanocracking Structure-Based Stretchable Strain Sensor. Sensors 2023, 23, 4941. https://doi.org/10.3390/s23104941
Yang S, Kim M, Hong SK, Kim S, Chung WK, Lim G, Jeon H. Design of 3D Controller Using Nanocracking Structure-Based Stretchable Strain Sensor. Sensors. 2023; 23(10):4941. https://doi.org/10.3390/s23104941
Chicago/Turabian StyleYang, Seongjin, Minjae Kim, Seong Kyung Hong, Suhyeon Kim, Wan Kyun Chung, Geunbae Lim, and Hyungkook Jeon. 2023. "Design of 3D Controller Using Nanocracking Structure-Based Stretchable Strain Sensor" Sensors 23, no. 10: 4941. https://doi.org/10.3390/s23104941