I’ve not heard of aria2c before today. Sort of a super wget as far as I could tell. Does parallel transfers to reduce data motion time, if possible.
So I pulled it down, built it. I have some large data sets to move. And a nice storage area for them.
Fire it up to pull down a 2GB file.
Much faster than wget on the same system over the same network. Wow.
Then the rest of the ML data set. About 120GB in all.
Yeah, this is a good tool. Need to make sure it is on all our platforms.
Sort of like gridftp but far more flexible.
Definitely a good tool.