A ND filter will only reduce the overall light entering your lens. It won’t help you with high contrast scenes. In your example the sky might be darker but the alley would be darker as well.

A CPL might cut some light from the sky but has other effects as well.

What you might wanna do is either bracket your shots (take multiple at different exposures) or lift the shadows in post. Or just blow out the skies.