I am reluctant to bring them in until the weather turns really frosty, but
after that I am not sure that a shed will keep them above 0C.

Will they be O.K. in their current pots away from serious frost?

They only need a touch of frost to kill them off so dont wait till
you've had frost to bring them in.