Is there any explanation on why only humans and animals do not remember previous life?

I have heard from a Buddhist monk that hungry ghosts usually return to their familis searching for food, which makes me believe they have easy access to memories of their previous life. Some hell beings also know what they did to deserve their punishment (according to what I have heard) so they have access to memories as well, I'm assuming devas should know it too. Apparently only Humans and animals do not remember previous lifes, is there a reason for that in the teachings?