Yes, always. Your ad accounts, pixels, analytics and domains stay under your business manager with you as the owner. We work as a partner with access, not as the account holder.
If we part ways, nothing has to be rebuilt and nothing goes with us. Some agencies structure this the other way, and it's worth asking any agency you talk to.