After hours of ripping my hair out and being completely confused. I finally managed to find a way to get Pico working with ALVR on Windows.
Made a guide on my website that could be useful for some.
https://snoot.red/blog/post/2025/05/02/guide-how-to-setup-a-pico-for-vr-with-alvr-on-windows/