Why you should use NFSv4 over NFSv3 in your Proxmox cluster - the difference is huge!
And if NFS has still too high latencies for you, my upcoming post of NVMe-oF (TCP) with SPDK will solve your issues.
#proxmox #nfs #storage #homelab #nfs3 #nfs4 #pnfs #nvmeof #nvme #latency
Not even bad the latency (this is just about latency, not overall bandwidth which reaches the full 4.9Gbit via 2x 2.5Gbit links).
Taken inside a Debian VM running on a Proxmox node connected to the storage:
GMKTec G9 NAS
2x 2.5Gbit
NFS 4.2 (with pNFS)
2x WD Back SN7100 NVMe
Mirror mode ZFS
While this are already pretty awesome latencies, let's see how it performs with SPDK and NVMe-oF (TCP).
#homelab #proxmox #storage #zfs #gmktec #gmktecg9 #latency #freebsd #NFS #SPDK #NVMe #NVMEoF
Just another preview of the @mikrotik #RDS2216 NVMe over TCP performance with a RAID10 of 4 Samsung PM9A3. The Linux VM maxed out the NIC when running the fio test for large files.
#HomeDC #homelab #NVMeOF
@erik @mikrotik As for the NVMe over TCP to the #vSphere host, i’m working on it, but needed 💤
#HomeDC #homelab #RDS2216 #NVMeOF
@erik
4x Samsung PM9A3 and 4x Samsung 990Pro in M.2 to U.2 cradle (cradle needs to be mounted upside down for NVMe connector connection). #RDS2216 #NVMeOF
@mikrotik The #RDS2216 ROSE arrived.
Time to load the NVMe 2.5” 7mm drives and NVMe M.2 2280 drives in their sleds.
#HomeDC #homelab #NVMeOF
iSCSI mounting working.
Next to install the latest version of democratic-csi to see if I can get the auto provisioning to work
NVMe over TCP vs iSCSI: Evolution of Network Storage
TLDR: In a direct comparison of NVMe over TCP vs iSCSI, we see that NVMe over TCP outranks iSCSI in all categories with IOPS improvements of up to 50% (and more) and latency improvements by up to 34%. When data grows, storage needs to grow, too. That’s when remotely attached SAN (Storage Area Network) systems come in. So far, these were commonly connected through one of three protocols: Fibre Channel, Infiniband, or iSCSI. However, with the latter being on the “low end” side of […]
Would absolutely love to have 3x of these #supermicro ruler storage #servers and make an #nvmeof cluster.
Out now, #RapidDisk Release 9.0.0. This is a HUGE release with many fixes and feature enhancements. More details including a changelog can be found here:
https://github.com/pkoutoupis/rapiddisk/releases/tag/9.0.0
#ssd #nvme #nvmeof #caching #ram #ramdrive #memory #linux #ubuntu #rhel #redhat #sles #debian
What better #introduction to #fosstodon than a look at what I think was my first #foss contribution. I’d like to apologize now for the unbounded memory allocation bug I introduced. Oops.
https://github.com/php/php-src/commit/72f675be5005f09c048155b85b5d6efd7341f6e0
Since then I’ve done a bunch of #sysadmin work (mostly #Solaris) followed by OS (#solaris #illumos #smartos #zfs) development and more recently various storage stuff (#nvme #nvmeof #roce #spdk #bluefield #dpu #smb).
I love #hiking through the #wilderness and other natural areas.
