Is it allowed to say thanks and sorry to a person for his favour or your mistakes?

I want to know like some person give me water when I was thirsty , so I thanked Allah for water and thanked the person too , I realised I should not say thanks to a non muslim or muslim I have to say may Allah bless you , is that right (similar case for sorry ) or I am allowed to say thanks and sorry ?