It seems to work out of the box... This was a fresh install yesterday (3.24) but I don't remember anything special about it with 3.22 - 3.23 either.
That said, "Spidey-sense" says I remember there is something dorked up about the handling for passwords under Alpine if you don't have ssh passwordless set up between hosts/accounts. I may be misremembering again or it may be ancient issues that no longer apply.
