Cable Robot Deep Learning With Transfer Learning Springer
Cable Robot Deep Learning With Transfer Learning Springer
net/publication/357505893
Model Free Error Compensation for Cable-Driven Robot Based on Deep Learning
with Sim2real Transfer Learning
CITATIONS READS
2 222
5 authors, including:
All content following this page was uploaded by Alexandr Klimchik on 06 November 2022.
Abstract. The paper deals with model-free error compensation for cable-
driven parallel robots based on the sim2real deep transfer learning. Par-
ticular attention is paid to simulation-based error estimation for different
payloads attached to the robot end-effector and the use of the Transfer
Learning approach for error compensation. This allows to reduce physi-
cal experiments with a real robot and gather sufficient data set within a
reasonable time, which is required for deep learning. The obtained results
were applied and validated for underactuated 4-dof (degrees of freedom)
cable-driven parallel robot. Model-free Deep learning-based methods for
a considerable training dataset provides better accuracy than simple lin-
ear error compensators using model-based calibration procedure. The
proposed sim2real Transfer Learning method allowed to speed up the
process of robotics system integration and recalibration due to the sig-
nificant sample efficiency improvement.
1 Introduction
Parallel cable-driven robots are a new automation tool for solving a number
of complex technological tasks. They are characterized by high payload, large
workspace for moving mobile platform, and low inertia properties. These primary
advantages allow to use the cable-driven parallel robots for different applications.
Their advantages include larger workspace [32], relatively small robot mass, abil-
ity to handle large payload, ability to operate with high speed and acceleration.
The main disadvantage of parallel cable-controlled robots is associated with the
complexity of physical modeling and, as a result, with the complexity of non-
linear compensation of geometric and non-geometric errors.
From an industrial point of view, the cable-driven robots can be used for:
– moving of heavy loads over long distances [3], [13], [15], [25];
– moving objects at relatively high speeds [16];
2 A. Akhmetzyanov et al.
– creating force feedback systems for virtual reality or for flying in aerotube
[24], [31];
– transportable and deployable systems for fast rescue operations [29].
One of the key moments for the control of such robots is the considering of
the elastostatic deformation and dynamics of the mobile platform, and cabling.
In particular, Zhang and Shang [43] worked for trajectory planning of the three
degrees underactuated cable-driven robot, taking into account the dynamic ef-
fects. In their work, the geometric approach for path planning was proposed,
which can also be applied when the mechanism is beyond the scope of static
equilibrium. Proposed by the authors approach gives an analytical solution that
enables positive and continuous tension in all control cables. Dynamics control
of actuators is also taken into account in [46] for precise control of large spheri-
cal radio telescope. Influence of dynamics on control for cable systems has been
shown in the work of Du et al. [9], where the authors used a dynamic model
with variable cable length for managing a mobile platform. Gosselin et al. [14]
used a dynamic simulation for the trajectory planning of the robot movement
beyond the static stability. The importance of dynamic modeling for the control
of cable robots supported by a large number of scientific papers devoted to this
aspect [34], [45]
Stiffness analysis of cable mechanisms examined in several works [27], [22].
In the work, Carricato and Merle [6] considered the problem of the properties
analysis of the robot in view of the rigidity and geometry. In the work [41] the
variable stiffness actuators were used to provide the desired characteristics of
the cable robot in a workspace. Static and dynamic analysis of cable robots with
the stiffness and weight control were considered in Yuan et al. [42].
One of the biggest challenges associated with cable robots is ensuring desired
properties of the robot in the operating area [36], [37]. Today, cable robots have
the most complex kinematics [28], which makes the task of analyzing the kine-
matic and dynamic properties of the manipulator in the workspace non-trivial
task [12]. The task of synthesis and optimization of cable robots is usually solved
separately for each application and set of requirements for certain properties of
the robot [38].
For more precise control of cable robots, the external measurement systems
can be used. In the paper [5] was presented a control algorithm for the cable
robot, the algorithm was based on machine vision. In the mentioned work, they
considered the kinematic simulation of a robot with four links, static and dy-
namic balancing, online image processing, and a variety of control algorithms.
Authors used an adaptive controller with integrated sliding recursive identifi-
cation to implement more precise control. Alternative control algorithms cable
robot based on vision systems used in the work [8], [7]. Adaptive control and
control based on the PID is also widely used to control the cable robot [4], [17].
In order to improve robot positional accuracy while performing technological
task in an industrial environment different on-line and off-line error compensa-
tion methods are used [40], [18], [20], which are aimed to minimize the influence
of geometric dynamic and elastic factors on the deviation of target position from
Model free error compensation based on sim2teal learning 3
the real one. In the cable-driven parallel robot, the end-effector position can be
changed only via adjustment cable lengths, which should rely on the correspond-
ing error compensation algorithm. That does not require controller modification
and makes the error compensation algorithm relatively simple for implemen-
tation by means of updating higher-level inputs only. In this case, in order to
achieve the desired positioning accuracy, it is required to give reference trajec-
tory as input that differs from the target one on the errors to be compensated
[21]. The input values are computed either iteratively using the kinematic model
or based on the Jacobian matrix [19].
In general, the error compensation algorithms can be split into two big
groups: based on some sophisticated model [19] or model-free compensation [44].
The first group can be easily adopted within the robot workspace but it is not
able to take into account any factor that is not described by the model. The
second group does not need any preliminary knowledge on the robot, may take
into account all possible factor influences on the robot positioning accuracy, but
frequently requires either a considerable amount of data for training (for machine
learning-based algorithms) or real-time estimation of the end-effector position.
Real-time estimation of the end-effector position is usually not possible on the
industrial floor; that is why this approach is commonly used for some validations
in the lab only. Recent research in kinematic error compensation shows the effi-
ciency of Deep learning and Reinforcement learning methods [35], [2] . The most
straightforward approach to compensate robot positioning errors is based on the
simple linear regression model which provides acceptable results for the majority
of real cases. Better results can be achieved using Deep Learning and Transfer
Learning approaches that are focused on in this work. This work is extension
of previously published work [2] containing additional experimental results and
analysis transfer learning effectiveness for model free error compensation.
2 System Overview
The cable-driven robot considered in this work consists of a frame, four winches
with cables, and a mobile platform (Fig. 1). Winch mechanisms are located at
the bottom of the frame. The cables are thrown through the guide rollers in
the upper part of the frame. Mountings of guide rollers can rotate around a
vertical axis, providing an orientation of the cables in the direction of the mobile
platform. The free ends of the cables are attached to a mobile platform on which
specific equipment can be placed.
The 4-cable robot belongs to the class of underactuated system. In this robot,
it is possible to control the position of the mobile platform and single orienta-
tion around virtual axis varying within the work-space. for such a system cable
sagging affects essentially the end-effector positioning accuracy.
Formally, 4 actuators should provide control of 4 degrees of freedom, for ex-
ample, they should allow to control the position of the mobile platform and the
4 A. Akhmetzyanov et al.
angle of rotation around a certain axis. However, the cables are non-restraining
geometric connections, which are closed only due to external forces acting on
the mobile platform. In other words, cables can only work in tension. There-
fore, using 4 cables, control of 4 generalized coordinates is possible only in such
configurations of the cable system in which one of the cables is an antagonist
for the other three cables, and at the same time its tension is ensured by the
external forces of the system. In the configuration of the cable robot under con-
sideration, the mobile platform is suspended from 4 cables. Therefore, none of
the cables can be an antagonist to the rest. And this means that to control 4
generalized coordinates, at least one of the cables must work in compression,
which is impossible.
The robot control system solves the inverse kinematics problem by deter-
mining the cable lengths according to the given position of the mobile platform,
taking into account the peculiarities of the winding mechanism and the guide
rollers construction [26]. However, this system does not take into account sag-
ging cables and other possible factors affecting the positioning accuracy of the
mobile platform.
The control system provides the ability to enter a compensating factor to
improve the accuracy of robot control [11]. But the problem is the complexity
of a fairly accurate estimate of the value of the compensating factor. Direct
measurement of the positioning error of the mobile platform during the operation
Model free error compensation based on sim2teal learning 5
of the robot is not always possible. A more accurate dynamic model of the robot,
taking into account many parameters, requires large computational costs during
the operation of the robot and the time required for calibration to determine the
values of these parameters. Accordingly, a high-speed neural network is a good
solution. Due to the Transfer Learning method, the time spent on retraining the
network on a particular robot will be comparable to the time spent on calibrating
the dynamic model.
To collect data for transfer learning we created the unity simulation of the cable-
driven parallel robot that integrated the physical engine. The robot structure
screenshot is available in Fig. 2. The robot consists of 4 elastic prismatic joints,
the end-effector, cable end object which connects prismatic joints to the end-
effector. We can control joint lengths and thus move the end-effector inside the
robot workspace. The end-effector mass influences the tension of robot springs
and changes the kinematics of the robot.
To collect the dataset for the transfer learning experiment we defined a set
of the target position and estimated their end-effector positions in the simulated
environments. The randomly generated joint length allowed to collect the dataset
for different situations. We performed the data collection for 2 different masses
which allowed to estimate the advantage from neural network weight transfer
for the training of the new error compensator.
The resulting dataset consists of the target and the measured positions in the
unity frame for 2 different masses and available under simulated kinematicsMass1.csv
and simulated kinematicsMass2.csv files in the dataset folder [1]. To further ap-
6 A. Akhmetzyanov et al.
ply this dataset to the real robot, the coordinate frame should be converted to
the robot coordinate system.
Transfer learning is a broad research field. Its application includes the Nat-
ural Language Processing field with word2vec [30], Reinforcement learning with
Curriculum [33], etc. The benefit of transfer learning is visualized in Fig. 4 [39]. It
allows us to improve initial accuracy, improve the slope of the training curve, or
increase the asymptote. In our robotics case, transfer learning can be potentially
used to compensate the impact of different payload application to our robot or
to speed up the process of regular robot re-calibration.
Employing testing the initial idea of applying a transfer learning approach for
cable-driven robot calibration, we modeled the robot in Unity with an integrated
Nvidia PhysX simulation engine. The originality of this work corresponds to the
Model free error compensation based on sim2teal learning 7
reduction of training set size required for the neural network through Transfer
Learning application and validation of the proposed approach on 4-dof cable-
driven robot.
To check the transfer learning viability for robot calibration tasks, we imple-
mented the following experiments. In the first one, we modeled a robot with
Unity and implemented simple inverse kinematics. Using this simulator, we col-
lected the inverse kinematics reference error dataset. In the second one, we
trained the error compensator on it. In the third one, we modified robot pa-
rameters to simulate the uncalibrated robot behavior with additional weight
applied to the end-effector and used transfer learning to speed up the process of
compensatory training. In the fourth experiment, we tried to verify the viability
of transfer learning to train compensators on the data from real robots. Finally,
we applied different weighed payloads on the robot and recalibrated the com-
pensator in a new usage scenario. The results, the dataset, the source code, and
the unity project are available in the GitHub repository [1].
accuracy of our model. Our loss is the arithmetic mean of absolute differences
between our target reference and predicted values.
We collected more than 2000 samples from real robots for 17 and 33 kg
masses. Visualizations of errors for 33 kg payload available in Figure 9. In the
real robot dataset, the linear shift of error also explicit. For 5 kg payload, we
have a 1.117m mean Z position and 1.085 m for 33 kg, which means that the
bigger mass pulls the end effector down. Our total error for 5kg: 0.198 m and
error for 33kg: 0.186 m. The training process is available in Figure 10 [2]. Test
error is 8.1 mm after training.
weights from simulated environments to train the real robot error compensator.
As a result, some constraints emerge. For example, the frames should be co-
directed, and scales should be the same. Normalization with zero mean and one
standard deviation helps to achieve this task. Fig. 12 and Fig. 13 show these
results [2].
4 Conclusions
Acknowledgements
Work was supported by the RFBR (Russian Foundation for Basic Research)(Grant
No. 19-08-01234).
References
2. Akhmetzyanov, A., Rassabin, M., Maloletov, A., Fadeev, M., Klimchik, A.:
Deep learning with transfer learning method for error compensation of cable-
driven robot. In: Gusikhin, O., Madani, K., Zaytoon, J. (eds.) Proceed-
ings of the 17th International Conference on Informatics in Control, Au-
tomation and Robotics, ICINCO 2020, Lieusaint, Paris, France, July 7-9,
2020. pp. 553–559. ScitePress (2020). https://doi.org/10.5220/0009905605530559,
https://doi.org/10.5220/0009905605530559
3. Albus, J., Bostelman, R., Dagalakis, N.: The nist spider, a robot crane. Journal
of research of the National Institute of Standards and Technology (97), 373–385
(1992)
4. Babaghasabha, R., Khosravi, M., Taghirad, H.: Adaptive robust control of fully-
constrained cable driven parallel robots. Journal of research of the National Insti-
tute of Standards and Technology (25), 27–36 (2015)
5. Bayani, H., Masouleh, M., Kalhor, A.: An experimental study on the vision-based
control and identification of planar cable-driven parallel robots. Robotics and Au-
tonomous Systems (75, Part B), 187–202 (2016)
6. Carricato, M., Merlet, J.: Geometrico-static analysis of under-constrained cable-
driven parallel robots. Advances in Robot Kinematics: Motion in Man and Machine
p. 309–319 (2010)
7. Dallej, T., Gouttefarde, M., Andreff, N., Dahmouche, R., Martinet, P.: Vision-
based modeling and control of large-dimension cable-driven parallel robots. In:
Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference
on 2012. pp. 1581–1586 (2012)
Model free error compensation based on sim2teal learning 17
8. Dallej, T., Gouttefarde, M., Andreff, N., Michelin, M., Martinet, P.: Towards
vision-based control of cable-driven parallel robots. In: Intelligent Robots and Sys-
tems (IROS), 2011 IEEE/RSJ International Conference on 2011. pp. 2855–2860
(2011)
9. Du, J., Bao, H., Cui, C., Yang, D.: Dynamic analysis of cable-driven parallel ma-
nipulators with time-varying cable lengths. Finite Elements in Analysis and Design
(48), 1392–1399 (2012)
10. Duka, A.V.: Neural network based inverse kinematics solution for trajec-
tory tracking of a robotic arm. Procedia Technology 12, 20–27 (12 2014).
https://doi.org/10.1016/j.protcy.2013.12.451
11. Fadeev, M., Maloletov, A.: Control of the four-cable-driven parallel robot with
the help of the inverse kinematic model. In: Proceedings of the 6th International
Young Scientists Conference on Information Technologies, Telecommunications and
Control Systems (ITTCS 2019) (2019)
12. Gao, B., Song, H., Zhao, J., Guo, S., Sun, L., Tang, Y.: Inverse kinematics and
workspace analysis of a cable-driven parallel robot with a spring spine. Mechanism
and Machine Theory (76), 56–69 (2014)
13. Gorman, J., Jablokow, K., Cannon, D.: The cable array robot: theory and experi-
ment. In: Proceedings 2001 ICRA IEEE International Conference on Robotics and
Automation (Cat No01CH37164) 2001. vol. 3, pp. 2804–2810 (2001)
14. Gosselin, C., Ping, R., Foucault, S.: Dynamic trajectory planning of a two-dof
cable-suspended parallel robot. In: Robotics and Automation (ICRA), 2012 IEEE
International Conference on 2012. pp. 1476–1481 (2012)
15. Gouttefarde, M., Collard, J., Riehl, N., Baradat, C.: Simplified static analysis of
large-dimension parallel cable-driven robots. In: 2012 IEEE International Confer-
ence on Robotics and Automation2012. pp. 2299–2305 (2012)
16. Kawamura, S., Choe, W., Tanaka, S., Pandian, S.: Development of an ultrahigh
speed robot falcon using wire drive system. In: Robotics and Automation, 1995
Proceedings, 1995 IEEE International Conference on 1995. vol. 1, pp. 215–220
(1995)
17. Khosravi, M., Taghirad, H.: Robust pid control of fully-constrained cable driven
parallel robots. Mechatronics (24), 87–97 (2014)
18. Klimchik, A., Ambiehl, A., Garnier, S., Furet, B., Pashkevich, A.: Ex-
perimental study of robotic-based machining. IFAC-PapersOnLine 49(12),
174 – 179 (2016). https://doi.org/https://doi.org/10.1016/j.ifacol.2016.07.591,
http://www.sciencedirect.com/science/article/pii/S2405896316308515, 8th IFAC
Conference on Manufacturing Modelling, Management and Control MIM 2016
19. Klimchik, A., Bondarenko, D., Pashkevich, A., Briot, S., Furet, B.: Compli-
ance error compensation in robotic-based milling. CoRR abs/1409.6231 (2014),
http://arxiv.org/abs/1409.6231
20. Klimchik, A., Pashkevich, A.: Robotic manipulators with double en-
coders: accuracy improvement based on advanced stiffness model-
ing and intelligent control. IFAC-PapersOnLine 51(11), 740 – 745
(2018). https://doi.org/https://doi.org/10.1016/j.ifacol.2018.08.407,
http://www.sciencedirect.com/science/article/pii/S2405896318315337, 16th
IFAC Symposium on Information Control Problems in Manufacturing INCOM
2018
21. Klimchik, A., Pashkevich, A., Chablat, D., Hovland, G.: Compliance er-
ror compensation technique for parallel robots composed of non-perfect
serial chains. Robotics and Computer-Integrated Manufacturing 29(2), 385
18 A. Akhmetzyanov et al.
40. Wu, Y., Klimchik, A., Caro, S., Furet, B., Pashkevich, A.: Geometric cal-
ibration of industrial robots using enhanced partial pose measurements and
design of experiments. Robotics and Computer-Integrated Manufacturing 35,
151 – 168 (2015). https://doi.org/https://doi.org/10.1016/j.rcim.2015.03.007,
http://www.sciencedirect.com/science/article/pii/S0736584515000411
41. Yeo, S., Yang, G., Lim, W.: Design and analysis of cable-driven manipulators with
variable stiffness. Mechanism and Machine Theory (69), 230–244 (2013)
42. Yuan, H., Courteille, E., Deblaise, D.: Static and dynamic stiffness analyses of
cable-driven parallel robots with non-negligible cable mass and elasticity. Mecha-
nism and Machine Theory (85), 64–81 (2015)
43. Zhang, N., Shang, W.: Dynamic trajectory planning of a 3-dof under-constrained
cable-driven parallel robot. Mechanism and Machine Theory (98), 21–35 (2016)
44. Zhao, G., Zhang, P., Ma, G., Xiao, W.: System identification of the
nonlinear residual errors of an industrial robot using massive mea-
surements. Robotics and Computer-Integrated Manufacturing 59, 104
– 114 (2019). https://doi.org/https://doi.org/10.1016/j.rcim.2019.03.007,
http://www.sciencedirect.com/science/article/pii/S0736584518306008
45. Zi, B., Duan, B., Du, J., Bao, H.: Dynamic modeling and active control of a cable-
suspended parallel robot. Mechatronics (18), 1–12 (2008)
46. Zi, B., Zhu, Z., Du, J.: Analysis and control of the cable-supporting system includ-
ing actuator dynamics. Control Engineering Practice (19), 491–501 (2011)