I loved this article from the Art of Manliness: Sunday Firesides: You Are Not Responsible for Other People’s Feelings
But when your decision doesn’t carry moral import, and you make it with all the politeness and respect possible, then you’re not responsible for how the other person deals with your choice. Whether they deal with it resiliently or not, rationally or not, generously or not, is up to them. You cannot control their reaction. And you cannot make your own decisions based on their expected response.
Coming to terms with unnecessary and unhealthy guilt has been a huge part of my mental health recovery process. It is vital to learn how to correctly identify your areas of responsibility and neither shirk nor stretch them.