Yes. If all of your releases are set to free, you can publish your artist page without connecting Stripe.
When Stripe is the only thing blocking publish, you'll see a shortcut to review your pricing, set everything to free, and publish in one step.
To sell music and receive payouts, you still need to connect a Stripe account. See Guide: Connecting Stripe to receive payouts when you're ready.
If your country isn't yet supported by Stripe, see What if my country isn't supported by Stripe? for more.