Frontiers in Robotics and AI

Journal: Frontiers in Robotics and AI

Abbreviation

Front. Robot. AI

Publisher

Frontiers Media

ISSN

2296-9144

Show all metadata

Search Results

Publications 1 - 10 of 25

Leveraging learned monocular depth prediction for pose estimation and mapping on unmanned underwater vehicles
Job, Marco; Botta, David; Reijgwart, Victor; et al. (2025)
Frontiers in Robotics and AI
This paper presents a general framework that integrates visual and acoustic sensor data to enhance localization and mapping in complex, highly dynamic underwater environments, with a particular focus on fish farming. The pipeline enables net-relative pose estimation for Unmanned Underwater Vehicles (UUVs) and depth prediction within net pens solely from visual data by combining deep learning-based monocular depth prediction with sparse depth priors derived from a classical Fast Fourier Transform (FFT)-based method. We further introduce a method to estimate a UUV's global pose by fusing these net-relative estimates with acoustic measurements, and demonstrate how the predicted depth images can be integrated into the wavemap mapping framework to generate detailed 3D maps in real-time. Extensive evaluations on datasets collected in industrial-scale fish farms confirm that the presented framework can be used to accurately estimate a UUV's net-relative and global position in real-time, and provide 3D maps suitable for autonomous navigation and inspection.
Soft Adaptive Mechanical Metamaterials
Khajehtourian, Romik; Kochmann, Dennis M. (2021)
Frontiers in Robotics and AI
Soft materials are inherently flexible and make suitable candidates for soft robots intended for specific tasks that would otherwise not be achievable (e.g., smart grips capable of picking up objects without prior knowledge of their stiffness). Moreover, soft robots exploit the mechanics of their fundamental building blocks and aim to provide targeted functionality without the use of electronics or wiring. Despite recent progress, locomotion in soft robotics applications has remained a relatively young field with open challenges yet to overcome. Justly, harnessing structural instabilities and utilizing bistable actuators have gained importance as a solution. This report focuses on substrate-free reconfigurable structures composed of multistable unit cells with a nonconvex strain energy potential, which can exhibit structural transitions and produce strongly nonlinear transition waves. The energy released during the transition, if sufficient, balances the dissipation and kinetic energy of the system and forms a wave front that travels through the structure to effect its permanent or reversible reconfiguration. We exploit a triangular unit cell’s design space and provide general guidelines for unit cell selection. Using a continuum description, we predict and map the resulting structure’s behavior for various geometric and material properties. The structural motion created by these strongly nonlinear metamaterials has potential applications in propulsion in soft robotics, morphing surfaces, reconfigurable devices, mechanical logic, and controlled energy absorption.
Modelling the Impact of Robotics on Infectious Spread Among Healthcare Workers
Vicente, Raul; Mohamed, Youssef; Eguíluz, Víctor M.; et al. (2021)
Frontiers in Robotics and AI
The Coronavirus disease 2019 (Covid-19) pandemic has brought the world to a standstill. Healthcare systems are critical to maintain during pandemics, however, providing service to sick patients has posed a hazard to frontline healthcare workers (HCW) and particularly those caring for elderly patients. Various approaches are investigated to improve safety for HCW and patients. One promising avenue is the use of robots. Here, we model infectious spread based on real spatio-temporal precise personal interactions from a geriatric unit and test different scenarios of robotic integration. We find a significant mitigation of contamination rates when robots specifically replace a moderate fraction of high-risk healthcare workers, who have a high number of contacts with patients and other HCW. While the impact of robotic integration is significant across a range of reproductive number R0, the largest effect is seen when R0 is slightly above its critical value. Our analysis suggests that a moderate-sized robotic integration can represent an effective measure to significantly reduce the spread of pathogens with Covid-19 transmission characteristics in a small hospital unit.
A Vision-Based Sensing Approach for a Spherical Soft Robotic Arm
Hofer, Matthias; Sferrazza, Carmelo; D'Andrea, Raffaello (2021)
Frontiers in Robotics and AI
Sensory feedback is essential for the control of soft robotic systems and to enable deployment in a variety of different tasks. Proprioception refers to sensing the robot’s own state and is of crucial importance in order to deploy soft robotic systems outside of laboratory environments, i.e. where no external sensing, such as motion capture systems, is available. A vision-based sensing approach for a soft robotic arm made from fabric is presented, leveraging the high-resolution sensory feedback provided by cameras. No mechanical interaction between the sensor and the soft structure is required and consequently the compliance of the soft system is preserved. The integration of a camera into an inflatable, fabric-based bellow actuator is discussed. Three actuators, each featuring an integrated camera, are used to control the spherical robotic arm and simultaneously provide sensory feedback of the two rotational degrees of freedom. A convolutional neural network architecture predicts the two angles describing the robot’s orientation from the camera images. Ground truth data is provided by a motion capture system during the training phase of the supervised learning approach and its evaluation thereafter. The camera-based sensing approach is able to provide estimates of the orientation in real-time with an accuracy of about one degree. The reliability of the sensing approach is demonstrated by using the sensory feedback to control the orientation of the robotic arm in closed-loop.
Experimental Evaluation of a Mixed Controller That Amplifies Spatial Errors and Reduces Timing Errors
Marchal-Crespo, Laura; Baumann, Tanja; Imobersteg, Michael; et al. (2017)
Frontiers in Robotics and AI
Research on motor learning suggests that training with haptic guidance enhances learning of the timing components of motor tasks, whereas error amplification is better for learning the spatial components. We present a novel mixed guidance controller that combines haptic guidance and error amplification to simultaneously promote learning of the timing and spatial components of complex motor tasks. The controller is realized using a force field around the desired position. This force field has a stable manifold tangential to the trajectory that guides subjects in velocity-related aspects. The force field has an unstable manifold perpendicular to the trajectory, which amplifies the perpendicular (spatial) error. We also designed a controller that applies randomly varying, unpredictable disturbing forces to enhance the subjects’ active participation by pushing them away from their “comfort zone.” We conducted an experiment with thirty-two healthy subjects to evaluate the impact of four different training strategies on motor skill learning and self-reported motivation: (i) No haptics, (ii) mixed guidance, (iii) perpendicular error amplification and tangential haptic guidance provided in sequential order, and (iv) randomly varying disturbing forces. Subjects trained two motor tasks using ARMin IV, a robotic exoskeleton for upper limb rehabilitation: follow circles with an ellipsoidal speed profile, and move along a 3D line following a complex speed profile. Mixed guidance showed no detectable learning advantages over the other groups. Results suggest that the effectiveness of the training strategies depends on the subjects’ initial skill level. Mixed guidance seemed to benefit subjects who performed the circle task with smaller errors during baseline (i.e., initially more skilled subjects), while training with no haptics was more beneficial for subjects who created larger errors (i.e., less skilled subjects). Therefore, perhaps the high functional difficulty of the tasks limited the potential benefit of mixed guidance. Adding random disturbing forces during training reduced the learning effect size compared to no haptics. The unanticipated forces also decreased the subjects’ feelings of competence while did not increase their effort and interest. Further studies with mildly affected neurologically patients employing easier tasks need to be performed in order to evaluate the applicability of our approaches in rehabilitation.
Markerless motion tracking to quantify behavioral changes during robot-assisted gait training: A validation study
van Dellen, Florian; Hesse, Nikolas; Labruyère, Rob (2023)
Frontiers in Robotics and AI
Introduction: Measuring kinematic behavior during robot-assisted gait therapy requires either laborious set up of a marker-based motion capture system or relies on the internal sensors of devices that may not cover all relevant degrees of freedom. This presents a major barrier for the adoption of kinematic measurements in the normal clinical schedule. However, to advance the field of robot-assisted therapy many insights could be gained from evaluating patient behavior during regular therapies.Methods: For this reason, we recently developed and validated a method for extracting kinematics from recordings of a low-cost RGB-D sensor, which relies on a virtual 3D body model to estimate the patient's body shape and pose in each frame. The present study aimed to evaluate the robustness of the method to the presence of a lower limb exoskeleton. 10 healthy children without gait impairment walked on a treadmill with and without wearing the exoskeleton to evaluate the estimated body shape, and 8 custom stickers were placed on the body to evaluate the accuracy of estimated poses.Results & Conclusion: We found that the shape is generally robust to wearing the exoskeleton, and systematic pose tracking errors were around 5 mm. Therefore, the method can be a valuable measurement tool for the clinical evaluation, e.g., to measure compensatory movements of the trunk.
An Adaptive and Hybrid End-Point/Joint Impedance Controller for Lower Limb Exoskeletons
Maggioni, Serena; Reinert, Nils; Lünenburger, Lars; et al. (2018)
Frontiers in Robotics and AI
Assist-as-needed (AAN) algorithms for the control of lower extremity rehabilitation robots can promote active participation of patients during training while adapting to their individual performances and impairments. The implementation of such controllers requires the adaptation of a control parameter (often the robot impedance) based on a performance (or error) metric. The choice of how an adaptive impedance controller is formulated implies different challenges and possibilities for controlling the patient's leg movement. In this paper, we analyze the characteristics and limitations of controllers defined in two commonly used formulations: joint and end-point space, exploring especially the implementation of an AAN algorithm. We propose then, as a proof-of-concept, an AAN impedance controller that combines the strengths of working in both spaces: a hybrid joint/end-point impedance controller. This approach gives the possibility to adapt the end-point stiffness in magnitude and direction in order to provide a support that targets the kinematic deviations of the end-point with the appropriate force vector. This controller was implemented on a two-link rehabilitation robot for gait training—the Lokomat®Pro V5 (Hocoma AG, Switzerland) and tested on 5 able-bodied subjects and 1 subject with Spinal Cord Injury. Our experiments show that the hybrid controller is a feasible approach for exoskeleton devices and that it could exploit the benefits of the end-point controller in shaping a desired end-point stiffness and those of the joint controller to promote the correct angular changes in the trajectories of the joints. The adaptation algorithm is able to adapt the end-point stiffness based on the subject's performance in different gait phases, i.e., the robot can render a higher stiffness selectively in the direction and gait phases where the subjects perform with larger kinematic errors. The proposed approach can potentially be generalized to other robotic applications for rehabilitation or assistive purposes.
Enhancing walking efficiency of adolescents with neurological impairments using an exosuit for ambulatory activities of daily living
Basla, Chiara; Mariani, Giulia; Wolf, Peter; et al. (2024)
Frontiers in Robotics and AI
Introduction: Children and adolescents with neurological impairments face reduced participation and independence in daily life activities due to walking difficulties. Existing assistive devices often offer insufficient support, potentially leading to wheelchair dependence and limiting physical activity and daily life engagement. Mobile wearable robots, such as exoskeletons and exosuits, have shown promise in supporting adults during activities of daily living but are underexplored for children. Methods: We conducted a cross-sectional study to examine the potential of a cable-driven exosuit, the Myosuit, to enhance walking efficiency in adolescents with diverse ambulatory impairments. Each participant walked a course including up-hill, down-hill, level ground walking, and stairs ascending and descending, with and without the exosuit’s assistance. We monitored the time and step count to complete the course and the average heart rate and muscle activity. Additionally, we assessed the adolescents’ perspective on the exosuit’s utility using a visual analog scale. Results: Six adolescents completed the study. Although not statistically significant, five participants completed the course with the exosuit’s assistance in reduced time (time reduction range: [-3.87, 17.42]%, p-value: 0.08, effect size: 0.88). The number of steps taken decreased significantly with the Myosuit’s assistance (steps reduction range: [1.07, 15.71]%, p-value: 0.04, effect size: 0.90). Heart rate and muscle activity did not differ between Myosuit-assisted and unassisted conditions (p-value: 0.96 and 0.35, effect size: 0.02 and 0.42, respectively). Participants generally perceived reduced effort and increased safety with the Myosuit’s assistance, especially during tasks involving concentric contractions (e.g., walking uphill). Three participants expressed a willingness to use the Myosuit in daily life, while the others found it heavy or too conspicuous. Discussion: Increased walking speed without increasing physical effort when performing activities of daily living could lead to higher levels of participation and increased functional independence. Despite perceiving the benefits introduced by the exosuit’s assistance, adolescents reported the need for further modification of the device design before using it extensively at home and in the community.
Observing the State of Balance with a Single Upper-Body Sensor
Paiman, Charlotte; Lemus, Daniel; Short, Débora; et al. (2016)
Frontiers in Robotics and AI
The occurrence of falls is an urgent challenge in our aging society. For wearable devices that actively prevent falls or mitigate their consequences, a critical prerequisite is knowledge on the user’s current state of balance. To keep such wearable systems practical and to achieve high acceptance, only very limited sensor instrumentation is possible, often restricted to inertial measurement units at waist level. We propose to augment this limited sensor information by combining it with additional knowledge on human gait, in the form of an observer concept. The observer contains a combination of validated concepts to model human gait: a spring-loaded inverted pendulum model with articulated upper body, where foot placement and stance leg are controlled via the extrapolated center of mass (XCoM) and the virtual pivot point (VPP), respectively. State estimation is performed via an Additive Unscented Kalman Filter (Additive UKF). We investigated sensitivity of the proposed concept to model uncertainties, and we evaluated observer performance with real data from human subjects walking on a treadmill. Data were collected from an Inertial Measurement Unit (IMU) placed near the subject’s center of mass (CoM), and observer estimates were compared to the ground truth as obtained via infrared motion capture. We found that the root mean squared deviation did not exceed 13 cm on position, 22 cm/s on velocity (0.56–1.35 m/s), 1.2° on orientation, and 17°/s on angular velocity.
Exploiting redundancy for UWB anomaly detection in infrastructure-free multi-robot relative localization
Salimpour, Sahar; Moron, Paola Torrico; Yu, Xianjia; et al. (2023)
Frontiers in Robotics and AI
Ultra-wideband (UWB) localization methods have emerged as a cost-effective and accurate solution for GNSS-denied environments. There is a significant amount of previous research in terms of resilience of UWB ranging, with non-line-of-sight and multipath detection methods. However, little attention has been paid to resilience against disturbances in relative localization systems involving multiple nodes. This paper presents an approach to detecting range anomalies in UWB ranging measurements from the perspective of multi-robot cooperative localization. We introduce an approach to exploiting redundancy for relative localization in multi-robot systems, where the position of each node is calculated using different subsets of available data. This enables us to effectively identify nodes that present ranging anomalies and eliminate their effect within the cooperative localization scheme. We analyze anomalies created by timing errors in the ranging process, e.g., owing to malfunctioning hardware. However, our method is generic and can be extended to other types of ranging anomalies. Our approach results in a more resilient cooperative localization framework with a negligible impact in terms of the computational workload.

Publications 1 - 10 of 25

Journal: Frontiers in Robotics and AI

Abbreviation

Publisher

Journal Volumes

ISSN

Description

Filters

Search Results