[NCLUG] A *nix DFS alternative?

[DJ Eshelman]

Under ideal conditions, I could see 10Mb/sec sustained, though I think 
it'll probably be more like 6Mb/sec (limited by upload speed from the 
main server- downloads top 30 Mb/sec with Comcast Business), but I can't 
have it high priority on the pipe so other services aren't affected.

Speed probably isn't the major factor, honestly; the whole reason to 
sync locally is to avoid having to download/cache each file 
individually; I can just have her work off of a Samba share to make it 
easy for her.  Initially I was thinking web folders and just place the 
whole thing out there hosted (we have a webserver on a Tier1 network), 
but the storage would get out of control quickly.  Actually, in thinking 
more about this I may decide to keep using that server as a front-end; 
it would cache files for clients, keeping an archived copy on my main 
server- then delete the files from the front-end after say 30 days.  
That may end up being the way I go down the road- but I just wanted 
something better than having her clients email attachments (yuck)

-DJ

On 2/22/2010 10:53 AM, grant at amadensor.com wrote:
>> I think for now I'm just going to make sure the file structuring is the
>> same on both ends and use rsync until things get out of hand.
>>
>> The torrent idea is interesting- I'll have to look into that some more-
>> I'm a little concerned about active changes and of course security- if
>> this solution is good for me, it's very likely we'll end up doing the
>> same thing at my office, which means we'll need encrypted transfers for
>> HIPAA and SBO compliance.  The Murder idea is an interesting use of the
>> Torrent structure- but I often wonder if it's the most efficient,
>> especially for large files.  I was also thinking about doing more
>> research into how Google does YouTube, but Google has always been an
>> enigma wrapped in a mystery :)
>>
>>      
> rsync will do the job.    Torrent is NOT the most efficient when you have
> only two nodes.   It is very fault tolerant, and scales well.  Versioning
> would only be possible by making a new file, and keeping track of the
> relationships between the torrent files outside the tool, or using a
> version control system like SVN.
>
> As for how Youtube does it:   Speed is just a question of money.   How
> fast do you want to go?
>
> _______________________________________________
> NCLUG mailing list       NCLUG at lists.nclug.org
>
> To unsubscribe, subscribe, or modify
> your settings, go to:
> http://lists.nclug.org/mailman/listinfo/nclug
>