Hello to anyone
I see issue on my cluster when tried create block volume via heketi
[root@heketi-75dcfb7d44-c5bqc /]# heketi-cli blockvolume create --ha 3 --size 1
Error: Failed to allocate new block volume: Block Hosting Volume Creation is disabled. Create a Block hosting volume and try again.
[root@heketi-75dcfb7d44-c5bqc /]# heketi-cli cluster list
Clusters:
Id:c0775ad2dfcd0957fc3a761fb00e06f9 [file][block]
[root@heketi-75dcfb7d44-c5bqc /]# exit
kubernetes@k8s-master-dev-1:~$ ksys exec -ti glusterfs-qczp9 bash
[root@k8s-node-dev-1 /]# systemctl status gluster-blockd
● gluster-blockd.service - Gluster block storage utility
Loaded: loaded (/usr/lib/systemd/system/gluster-blockd.service; enabled; vendor preset: disabled)
Active: inactive (dead)
Oct 17 20:23:10 k8s-node-dev-1 systemd[1]: Dependency failed for Gluster block storage utility.
Oct 17 20:23:10 k8s-node-dev-1 systemd[1]: Job gluster-blockd.service/start failed with result ‘dependency’.
[root@k8s-node-dev-1 /]#
Whats wrong?
I'm using heketi on k8s
Just for info, issue above related to https://bugzilla.redhat.com/show_bug.cgi?id=1462792 and solved :)
Hi,all. Can I achieve conditional mount using glusterfs? Here is my situation. I have several groups, and each group have the same directory structure but with different group data. Can I pass a parameter such as group name, so that glusterfs can determine using which group file. For example, I have a directory named "root_dir", and inside the root_dir , I have three sub-directory, namely the "group_one", "group_two", "group_three". I mount the "root_dir" to a kubernetes pod, and the current group is group one , so I want the files in "group_one" is available with "rwx", but the other two sub-directories are unavailable with"---".
Hi all. My home gluster setup seems to have gotten messed up again after a reboot. I have multiple bricks all in a 2+1 replica with an arbitor. After the reboot it seems like running commands from arbitor server are painfully slow and time out (peer status, volume info). When the arbitor is down it functions normally. The interesting thing is all three hours also locally mount the bricks and data is available on all. I'm not sure how to troubleshoot this.
Hello everyone, I have a geo replication setup running and have noticed that gluster brick for changelogs/htime file keeps growing in size. I have been reading that it is used by geo replication. However is there a way i can either archive or discard some of the data. I Have seen the HTIME file go up to 200 mb. If theres a way i can safely shorten the file or archive. That will be helpful. Thanks
Hey there! I am having zero luck building any of the branches on Ubuntu 18.04 -- anyone have ideas? Without tirpc it complains libgfrpc has no reference to
log2 -- with tirpc 'release-5' fails at https://gist.github.com/DamonBlais/f1b409e83de7d7e9cba6a1d236c8f738
'release-6' and 'master' fail at the same spot with libtrpc-dev installed from Ubuntu 18.04 repository. With the library removed from the system, they fail at libgfrpc instead. https://gist.github.com/DamonBlais/2b1fb66e7b9eba577c6034cef407617d
script / lines used to compile (from the documentation, with a little more verbosity) https://gist.github.com/DamonBlais/bc44b719950451c3dd7235d8b795f500
I tried to set features.file-snapshot on my volume using gluster 5.3
volume set: failed: option : features.file-snapshot does not exist
im trying to accomplish file level snapshots
Hi guys , I have a question
I have a distributed replicated 2x2 configuration, How can I add other two bricks in a new node In a way that all the bricks are well rebalanced across the three nodes? in my tests the 2 bricks added (from the same node) after a rebalance contain the same data, which isn't the best for fault tolerance (if this node goes down the data is lost)
I have a distributed replicated 2x2 configuration, How can I add other two bricks in a new node In a way that all the bricks are well rebalanced across the three nodes? in my tests the 2 bricks added (from the same node) after a rebalance contain the same data, which isn't the best for fault tolerance (if this node goes down the data is lost)
Hey guys quick question.
I want to share certain directories replicated between 2 servers. For example i want /home/user/dir1 , home/user/dir2 /and home/user/dir3/dir1 to be common on both servers. But the naming cannot change since it's used by the setup given already.
Question 1 : Is it a killer to crate and mount 3 different replica volumes, one for each?
Question 2 : Can it be done with a single Volume somehow and still keep the replication?
My problem right now is that the single mount will keep the contents of each directory. Note that each directory give has multiple more directories on the same level so bricking this level is impossible by my understandings so far(will also replicate all other dirs on same level)
I want to share certain directories replicated between 2 servers. For example i want /home/user/dir1 , home/user/dir2 /and home/user/dir3/dir1 to be common on both servers. But the naming cannot change since it's used by the setup given already.
Question 1 : Is it a killer to crate and mount 3 different replica volumes, one for each?
Question 2 : Can it be done with a single Volume somehow and still keep the replication?
My problem right now is that the single mount will keep the contents of each directory. Note that each directory give has multiple more directories on the same level so bricking this level is impossible by my understandings so far(will also replicate all other dirs on same level)
I'm in the process of deploying gluster to provide persistent storage for jupyter notebooks. I'm using heketi as a rest endpoint, which creates a block for each persistent volume claim. Is there an upper limit to the block ports (49152-), or do I need to open 800+ ports for 800+ blocks?
May i ask how is the performance of gluterfs overall? I wish to sync a media catalog of a store ~120gb images mainly. I tried to set it up, but i dont even know if i configured the thing correctly and the drives were not ssd so the performance was really bad. Also the fs was ext3 or 4 i dont remember right now, it was on an old demo server
The sync should basically happen between 2 servers
Just tryig to move a 10gigs folder in a brick to be copied to the other server, took over an hour
Hi there... I'm a new gluster use, I'm looking to some advice...
I have 3 Dell node with 6 SAS disk. I setup a Proxmox cluster with one disk for proxmox and the other 5 dedicated to Gluster.
Seems working well but if I create a replicated volume I lose 2/3 of available space.
There is another way to handle disk space with gluster?
I have 3 Dell node with 6 SAS disk. I setup a Proxmox cluster with one disk for proxmox and the other 5 dedicated to Gluster.
Seems working well but if I create a replicated volume I lose 2/3 of available space.
There is another way to handle disk space with gluster?
Distributed seems to be not a good choice because if I have a fail I lose everything, right?
How about create a gluster distributed volume of 3 big brick built on top raid5 on every node? Is a bad idea?
2019-09-04 16:24:27 (890 KB/s) - Connection closed at byte 65137. Retrying.
This is what I am getting. Using
wget https://download.gluster.org/pub/gluster/glusterfs/4.1/4.1.8/Debian/9/amd64/apt/pool/main/g/glusterfs/glusterfs-client_4.1.8-1_amd64.deb
Jesse Hi! I'm looking to move my zfs to glusterfs at some point - for encryption, I'm thinking ecryptfs, do you guys think that is fine? My nodes will be very low powered ARM devices, idk how LUKS would perform on them, and gluster's encryption doesn't encrypt file names from what I understand.
If I do:
sudo mount -t glusterfs server:myvol1 /mnt/filestoreI get:
mount: exec /Library/Filesystems/glusterfs.fs/Contents/Resources/mount_glusterfs for /mnt/filestore: No such file or directoryif I do:
sudo mount server:myvol1 /mnt/filestoreI get:
mount_nfs: can't mount myvol1 from server onto /mnt/filestore: Permission denied
Can mount it fine on a remote linux machine
I'm guessing there's not mac client?
Hi, I'm just getting started with gluster and testing it. I regularly loose a brick daemon on my host. In the brick logs I see
aio_read_error() on /gluster/G2/data/.glusterfs/health_check returned after that the glusterfsd is killed with signum 15. Is this expected behavior? I have no idea what causes the aio_read_error and why the daemon is not restarted.
I'm using glusterfs 7.2-1
@soonnyblack Please join Gluster Slack https://join.slack.com/t/gluster/shared_invite/enQtODMwMDU5MTI0OTQ3LTNjMTA4NTJmMDY3OGM4YTA0ZDlhOGM5ZWYzNjRkYmQ0Mjg3NDUxODRjZGI4ZjQxNDczNTYxZWZjMmY5NDMyNzM
Hello everyone. I ported the latest version of glusterfs 9dev to the arm 32-bit platform. I created a disperse volume on six nodes with two redundant nodes. Then mount it to a directory. I used the tool FIO to compare the read/write rate of a single disk with that of a glusterfs volume. I thought that the read / write rate of a distributed volume should be about four times that of a single disk. As a result, the read-write rate of distributed volume is not as high as that of single disk. I see that when I write disks, they are written concurrently, not sequentially. Why is that?