No, you would have to do some authentication at a physical bank itself.
You can use the numbers to request a wire transfer from the account. In fact, when you're setting up an ACH transaction for bills and such, they tell you to get the numbers from a check.
You can seriously just say a bank account number at a bank in the US and walk away with a bag of cash from it, with no other security checks at all?
In the UK they’d make you enter a password or PIN or use 2FA.