Big upload manager project guidance

(imported topic written by SystemAdmin)

All

I have a project coming up that will have me importing a large amount of spb files (over 100Gbs worth) into TEM. These are the legacy data files from our software packages in TPM.

I am eager to hear any thoughts on expectations, recommendations, information that you all can provide me, and what I should be concious of.

Thanks.

(imported comment written by MattBoyd)

Perhaps you would be better off hosting them on a separate web server and having TEM download/cache them in the same way it does for patches and updates, instead of uploading them to TEM. You’d just need to calculate the sha1 hash of each file on your own. For that, I use Hash My files (http://www.nirsoft.net/utils/hash_my_files.html).

If compressing them significantly reduces the size, you could use 7-zip to compress (server side) and extract (client size). Again, this may be faster than the TEM Software Distribution Wizard.

(imported comment written by SystemAdmin)

Thank you for the information Boyd, however I am not sure I will be able to use this procdure as it would add additional software to my environment that I will need to maintain.

Have you run into issues doing it the conventional way? (dashboard)

(imported comment written by MattBoyd)

weberch

Thank you for the information Boyd, however I am not sure I will be able to use this procdure as it would add additional software to my environment that I will need to maintain.

Have you run into issues doing it the conventional way? (dashboard)

Not since upgrading to v8. Prior to that, there was a 2GB limit per file, which typically meant splitting larger files up using 7-zip.

(imported comment written by jeremylam)

There is also a command line utility, uploadmanager.exe, that can automate the uploads.

http://support.bigfix.com/cgi-bin/kbdirect.pl?id=1743

(imported comment written by SystemAdmin)

Thanks Boyd.

Yeah, Jeremy, that is what I plan on using. I just want to get thoughts from those that have done this process… take aways that I may use in my project to make sur eit is successful.