Thank you for looking into this, LeoW. FUSE is working for me on Windows.
I also noticed I was on an older version of Cryptomator. I upgraded and set the volume type to Automatic. This is also working now.
Presumably, it’s picking WinFsp, since I no longer see FUSE as an option. The remaining types are Dokany and WebDAV which didn’t work.
Also found that Dokany support is deprecated, so changing the volume type (or setting it to Automatic) seems like the way forward: Volume Types — Cryptomator 1.7.0 documentation.