254 questions
0
votes
1
answer
100
views
Open Media Vault on Proxmox Write Speed drops
SOLVED: I decided to mount both drives directly on a Open Media Vault VM per Pass Through
stop VM nano /etc/pve/qemu-server/.conf scsiX: /dev/sdX start VM
And in there create a Mirror RAID and then an ...
0
votes
0
answers
36
views
How do I see the actual file size of a partitioned postgres table on ZFS?
I am trying to benchmark postgres (17) on ZFS (ubuntu). I created a partitioned table and want to see the actual number of bytes required to store the data on the table. I am under the impression ...
- 977
0
votes
0
answers
121
views
How to programmatically detect if a path is a ZFS snapshot?
All ZFS snapshots have paths like "/mount/point/path/.zfs/snapshot/NameOfSnapshot", but not all paths that can conceivably contain "/.zfs/snapshot/" are necessarily ZFS snapshots. ...
- 3,910
1
vote
0
answers
323
views
How do I create zfs volumes with docker compose?
I've patched a docker zfs plugin to make it work with docker composes's ideas on container naming, so docker volume create -d zfs my-volume creates my-volume under specified in config filesystem.
...
- 412
0
votes
1
answer
510
views
Merging two raidz1 vdevs on ZFS to have only ONE redudundant drive
I currently have three 18tb drives under a raidz1 vdev. I bought three new drives to double my space. However when I added these three drives, I can just create a separate raidz1-1.
But that means out ...
- 239
0
votes
0
answers
51
views
Tried to get zfs to replace faulty drive but ended up in this configuration mess. How to resolve?
Getting the issue below, Trying to replace ata-ST3000... drive but ended up with this configuration mess. How can I get the new drive to be inside raidz1-0? Help appreciated.
Thanks
# zpool status
...
- 11
2
votes
1
answer
1k
views
How I do "NVMe overprovisioning"?
I want to use NVMe overprovisioning on a NVMe disk with ZFS. I have read this: https://openzfs.github.io/openzfs-docs/Performance%20and%20Tuning/Workload%20Tuning.html?highlight=ashift#nvme-...
- 339
0
votes
1
answer
435
views
ZFS: "convert" a pool into a filesystem
I've created a pool trunk that is mounted under say /X. I didn't realize that I should have created a filesystem on that pool, so people on a shared server started to directly write into /X. Now I ...
- 2,860
1
vote
1
answer
3k
views
ZFS stalled, task txg_sync blocked for more than 120 seconds
A scrub was running, which got stuck, I restarted the server to attempt to resolve the issue, however this caused ZFS to stall instantly (zpool, and zfs) commands just run indefinitely with the ...
- 21
0
votes
1
answer
1k
views
Recovering zfs pool
I have a zfs pool setup on my ubuntu 20.04 system. I had 4 drives and decided to replace 1 of them for a larger one. I tried to offline the drive, then powered off, replaced with new drive, powered ...
0
votes
1
answer
2k
views
I need docker instance to NOT utilize the host swap
My server build uses a lot of swap per container and I am told that docker uses the host swap for instances. My host ssd is only 256gb and is only intended to run the OS. I have setup a zfs pool (9 Tb ...
- 11
0
votes
2
answers
3k
views
ZFS send single snapshot including descendent file systems
Is there a way to send a single snapshot including descendant file systems? 'zfs send' only sends the the top level file system even if the snapshot was created using '-r'. 'zfs send -R' sends the ...
- 51
3
votes
2
answers
2k
views
Right way to use docker rootless mode on ZFS filesystem
I configure my docker to be used with rootless mode and it works fine. But I changed my data-dir to store all the docker's data in a zfs filesystem. It appears that it is not working directly and I am ...
- 609
3
votes
1
answer
883
views
ZFS SSD pool - Postgres setup really slow for large table ALTER command Write operations)
We recently moved a db(1.2TB) cluster from mirrored SSD to ZFS pool build-up of SSD. After the move, I have seen a massive drop in performance on large write operations (Alter table types, vacuums, ...
- 119
-1
votes
1
answer
1k
views
ZFS after disk failure: most of data seems to be intact, but how to extract?
I have a zpool after disk failure. Attempt to import it (even zpool import -F -T 12855264 -R /mnt -f rpool) yields errors
Dec 4 12:56:54 freebsd kernel: Solaris: WARNING: can't open objset 1035, ...
- 412
0
votes
1
answer
2k
views
ZFS send recursive failing on datasets without the specified snapshot
I have a situation in my current zfs pool that I do not quite understand and also cannot reproduce in a testing environment.
I am trying to send an incremental and recursive snapshot to another a ...
- 83
2
votes
0
answers
652
views
Elasticsearch response times are high even when query time is low
I'm seeing high response times on elasticsearch searches (took is 5000ms) but if I check profile, query time is low ~15ms. I think this only happens when the request rate is high, but CPU is also far ...
- 1,221
0
votes
1
answer
934
views
K0s in LXC and ZFS issues
I'm trying to get K0s working in LXC (LXD) containers on Ubuntu 20.04 using ZFS and I've managed to get past the apparmor challenges (for now at least) but stuck on overlayfs issues during the install ...
- 75
1
vote
1
answer
354
views
How does Flash Translation Layer store mapping data, unusable block and super block?
Does ftl have private storage space that is not flash？
If not, how does ftl store those meta data while avoiding wear leveling.
Actually I don’t know if there is a super block in ftl, but if you want ...
- 755
0
votes
0
answers
927
views
How can i set qouta on docker volume with zfs
I want to set a hard limit for the volume to grow. How can i do it with docker-compose? Right now i have zfs as the fs for /var/lib/docker. My current volume part looks like this:
volumes:
vol1:
...
- 115
1
vote
0
answers
54
views
bash script doing back-up malfunctions when run via systemd
I have bash script that takes ZFS snapshot and via piping uploads it to s3 bucket. This is the gist of it:
torun="zfs send -c ztank/data@$BACKUP_NAME | openssl enc -aes-256-cbc -iter 1000 -salt -...
- 311
3
votes
1
answer
9k
views
How to fix docker storage-driver=overlay2 problem
I need to change the underlying storage for a Proxmox LXC Debian Buster container from RAW to ZFS. For this I restored a snapshot to ZFS storage. This is normally transparent for the OS in the ...
- 234
1
vote
1
answer
569
views
Slow zfs create with thousands of datasets
I am creating a zfs system where each instance of a certain entity in my system has its own dataset in zfs. This is needed because each entity consists of a lot of small files that are really slow to ...
- 83
3
votes
2
answers
10k
views
mkfs.vfat: unable to open {partition}: No such file or directory (command succeeds, but throws this error and blocks rest of script)
Update: I got this working but am still not 100% sure why. I've appended the fully and consistently working script to the end for reference.
I'm trying to script a series of disk partition commands ...
- 19.5k
2
votes
0
answers
3k
views
Zpool import - one or more devices is currently unavailable
When attempting to import a zpool with -m (also -F and -f and combinations thereof), I receive: "cannot import 'tank2': one or more devices is currently unavailable"
I believe the missing ...
- 51