Discuss (FTP) and (SFTP, FTPS and SCP), our Java file transfer clients.

How to improve performance

no avatar
User

eting

Posts

4

Joined

Fri Aug 08, 2008 5:09 am

How to improve performance

by eting » Wed Apr 15, 2015 10:47 am

Hi,
We are using edtFTPj/Free, and wondering what are our options for improving performance. Currently in one transfer, we want to transfer files that total about 24GB, and it takes 8 minutes to do the transfer. Some options I thought of:
1) Upgrade to edtFTPj/Pro, and use asynchronous methods. http://enterprisedt.com/products/edtftp ... thods.html. This will essentially implements multi-threading for us, even though our code does not have multi-threads
2) Upgrade to edtFTPj/Pro, and try the MODE Z data compression (if my FTP server supports it). http://enterprisedt.com/products/edtftp ... ssion.html
3) In our code, compress the files into a single zip before transferring
4) Does it help to add a CPU core to our virtual machine that's running our code?
5) Any other options?

There's a page in the manual on 'how to make transfers faster', but it's blank: http://enterprisedt.com/products/edtftp ... aster.html. What are the contents on this page?

Thank you
E
no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

Re: How to improve performance

by support2 » Wed Apr 15, 2015 4:43 pm

24 GB in 8 minutes is roughly 400 Mbs, so that seems pretty fast. How fast is Filezilla in comparison?

1) If you have multiple transfers, it may help to use edtFTPj/PRO's connection pool and asynchronous methods to do simultaneous transfers - best to download the trial and test.

2) MODE Z is much faster if you are transferring uncompressed text files, but won't make much difference for files that are already compressed.

3) A good option if you are transferring many smaller files.

4) It depends if your process is cpu-bound or io-bound. Use some monitoring tools to see how much cpu is being used.

I've fixed the blank page - thanks for letting us know.
no avatar
User

eting

Posts

4

Joined

Fri Aug 08, 2008 5:09 am

Re: How to improve performance

by eting » Thu Apr 16, 2015 6:42 am

Thank you so much for your quick response and for fixing the help page. It's very helpful. I've passed the info onto our team and will do a few tests as suggested first.

Thanks,
E

Who is online

Users browsing this forum: No registered users and 13 guests

Powered by phpBB ® | phpBB3 Style by KomiDesign