Important question... had you asked your current employer about remote working before?
If yes, and they said "no remote work", then the culture probably wouldn't be a good fit. You'd be the 'exception to the rule' and probably miss out on a bunch.
If no, then lesson learned you need to better communicate your career growth desires to your management team... but then I'd say it comes down to your upward mobility, where you're more excited to be, etc.