Boston Linux & UNIX was originally founded in 1994 as part of The Boston Computer Society. We meet on the third Wednesday of each month at the Massachusetts Institute of Technology, in Building E51.

BLU Discuss list archive


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Discuss] Mirroring of files to all nodes in a cluster



What we're looking for is to just write to one (master) node and have 
that get replicated to the others, with all the other nodes only being 
read, not written to.

Thanks for the suggestion on AndrewFS.  I hadn't heard of that - will 
take a look.

NFS wouldn't be a fit since it's a similar use case to Gluster - i.e., 
the data would need to be accessed over the network, rather than from 
the local disk.

Thanks,

DR

On 2017-11-21 3:34 pm, Betsy Schwartz wrote:
> Do you need read-write replication across all nodes?
> 
> AndrewFS will do read-only replication, although I haven't looked at
> the details.
> 
> For read-write you might look at something like owncloud.
> 
> (I assume you've ruled out just using NFS...?)
> 
> 
> On Tue, Nov 21, 2017 at 2:20 PM, David Rosenstrauch <darose at darose.net> 
> wrote:
>> I'm looking for a Linux utility that will allow me to mirror/replicate 
>> a
>> directory tree onto each and every node in a cluster, so that the data 
>> will
>> reside on the local disk on each machine.  However, I'm not seeing 
>> anything
>> that quite fits that bill.  So far I've found:
>> 
>> * DRBD
>> * Gluster FS
>> 
>> However, each one doesn't seem to achieve what I want in some key way:
>> 
>> * DRBD seems to only really work for 2-node master/slave replica type
>> setups.  However I'm going to have a master and multiple slaves (at 
>> least 3
>> right now, and almost certainly more in the future).  It doesn't sound 
>> like
>> DRBD supports that.
>> 
>> * Gluster seems to be a distributed file system.  I.e., the data gets
>> sharded and spread across the multiple nodes in the cluster.  However, 
>> this
>> would mean that there is not a complete local copy on each node.
>> 
>> Anyone have a recommendation for tool that will achieve what I want?
>> Obviously homegrown rsync scripts running on each node would be an 
>> option
>> here, but I was hoping to not have to roll my own solution for this.  
>> Also,
>> of course, if I'm mistaken about either DRBD or Gluster's 
>> capabilities,
>> please feel free to correct.
>> 
>> Thanks,
>> 
>> DR
>> _______________________________________________
>> Discuss mailing list
>> Discuss at blu.org
>> http://lists.blu.org/mailman/listinfo/discuss



BLU is a member of BostonUserGroups
BLU is a member of BostonUserGroups
We also thank MIT for the use of their facilities.

Valid HTML 4.01! Valid CSS!



Boston Linux & Unix / webmaster@blu.org