Windows
Gajim
Gajim is a fully featured Jabber/XMPP app that runs on Windows. Get it from their website or here:
Movim
Movim is a web-client that works well in browsers like Firefox or Chromium. It can be installed as a PWA app by visiting a Movim instance and selecting the "Add to home screen" option from the menu of your browser. Push notifications can be enabled in the Movim settings and will be delivered through the browser's web-push feature.