this has not been validated end-to-end by anyone including me, so be warned :-)
- try using shairport instead of squeezelite as the client
- try using sendspin instead of squeezelite (currently onnly supports one output format so not an option yet)
scyto
/ 1-ct-converted-to-ma.md
Last active
December 26, 2025 20:52
CasaTunes Conversion to Music Assistant
I have other devices that need to access the ceph mesh that are on my LAN. This gist is only needed if you want LAN clients to access the ceph mesh.
- let any client on LAN access the mesh
- avoid setting static routes on my router
- enable support for routing topology changes without having to reconfigure router
scyto
/ refactor2.md
Last active
December 17, 2025 14:00
scyto
/ refactor1.md
Created
April 28, 2025 04:45
scyto
/ routed-vm-mesh-access.md
Last active
December 17, 2025 14:01
how to access proxmox ceph mesh from VMs on the same proxmox nodes
Routed is needed, you can't jut simply bridge en05 and en06 and have VMs work, bridging seems to not work on thundebolt interfaces, at least i could never get the interfaces working when bridged and it broke the ceph mesh completely.
tl;dr can't bridge thunderbolt interfaces
scyto
/ docker-vm-ceph-setup.md
Last active
December 17, 2025 14:01
2025.04.27 - currently untested e2e this was made from my raw notes by chatgpt, so erros and hallucianation may have crept in :-)
This document describes the clean, final method to mount a CephFS filesystem for Docker VMs across your cluster.
Assumptions:
- you have a working cephFS volume called docker (out of scope)
- that you can see this volume just fine mounted on all 3 pve nodes (if you can't then this is never going to work)
- that you are using the IPv6 version of my ceph proxmox setup (not critical, just sawp out IPv6 for IPv4 address below)
This document describes the original setup to establish an FRR (Free Range Routing) OpenFabric IS-IS based IPv6 routed mesh over Thunderbolt networking between Proxmox nodes, using static /128 loopback addresses in the fc00::/8 ULA space.
This provided:
scyto
/ ceph-ip-migration-on-proxmox.md
Last active
July 21, 2025 19:27
migrate ceph network from /128 IP addresses to /64
IF YOU FIND THIS GIST THIS IS A ROUGH GUIDE TO CHANING CEPH IP AND SUBNETS - MY ADVICE IS DONT IT IS BAD EVERR TIME AND THIS IS ROUGH STEPS IN REALITY ITS MISSING SOME STEPS
I learn't an important lesson today, never ever remove ms_bind_ipv4 = false from ceph.conf or the cephFS will be fucked. note also recreating the mgrs and mds seems advisable too
only ever reboot one node, if that doesn work or you see libceph error storm when it reboot - solve that first (make sure no wrong mons defined in storage.cfg or ceph.conf)
scyto
/ dual-stack-openfabric-mesh-v2.md
Last active
December 3, 2025 02:32
New version of my mesh network using openfabric
this gist is part of this series
This assumes you are running Proxmox 8.4 and that the line source /etc/network/interfaces.d/* is at the end of the interfaces file (this is automatically added to both new and upgraded installations of Proxmox 8.2).
This changes the previous file design thanks to @NRGNet and @tisayama to make the system much more reliable in general, more maintainable esp for folks using IPv4 on the private cluster network (i still recommend the use of the IPv6 FC00 network you will see in these docs)
scyto
/ docker-cephfs-virtiofs.md
Last active
December 9, 2025 10:31
Hypervisor Host Based CephFS pass through with VirtioFS
This is currently a work-in-progress documentation - rough notes for me, maybe missing a lot or wrong
The idea is to replace GlusterFS running inside the VM with storage on my cephfs cluster. This is my proxmox cluster and it runs both the storage and is the hypervisor for my docker VMs.
Other possible approaches:
- ceph fuse clien in VM to mount cephFS or CephRBD over IP
- use of ceph docker volume plugin (no useable version of this yet exists but it is being worked on)
Assumptions:
NewerOlder