It’s not about other people and what they do or don’t do. It’s about knowing yourself and knowing your limits. Mental health and physical health are just as important. If you didn’t feel safe to drive or go in then trust yourself that you made a good call. I don’t think it’s unethical. It doesn’t sound like you were trying to get away with anything or manipulate anything. You did what you could for you based on the information you had and how you were feeling. Be kind to yourself.