Is it permitted to eat fruit from tree that has root in neighbour's house but some part of it hangs on my wall?

There is a tree that bears fruit e.g. grapes or mangoes. The tree has its roots in the neighbour's house and a large part of the fruit is also in the neighbour's house. But, some part of that tree has its branches all over a tree that is in my house. Those branches have fruit. Can that fruit be eaten? - I am looking for a reference from Quran or Hadith. - The concept of stealing does not apply here because the neighbour is aware. My question is purely from Islamic point of view.