Asking about Parent-Child relationship karma. Is it bad if I don't wanna go visit my dad?

My parent seperated since I was young and I was rise by my mom. Right now my dad is not in a good condition and unfortunately my aunt and uncle from my dad's side doesn't like me much. Too be honest I don't wanna face with my aunt. I know she loves him so much and she hates me because I choose to stay with my mom. I don't know what to do. For example today I told my mom I will go visit my dad but mom said she needs me to have a dinner with her.so she told me to go visit my dad the other day... If I don't go visit him.. Will it be bad ? I know this is such a stupid question but it is hard for me to make up my mind. When I see my dad It is not so peaceful inside because of the people around him...