Starting with Apache 2.4.5 it is now at least possible to proxy websockets using apache. But apparently goes out of their way to make it as hard to proxy as possible...

<VirtualHost *:443>
        #Redirect /
        RewriteEngine on

# fuck
RewriteCond %{QUERY_STRING} !transport=websocket
RewriteRule /(.*)$$1 [P]

ProxyRequests off
ProxyPass / ws://localhost:4242/
ProxyPassReverse / ws://localhost:4242/

        SSLEngine On

Btw, the reason I had to put this on https is... I kind of outsmarted myself by switching on HSTS on my site, not thinking about the fact this propagates to all subdomains and ports!