Jesus is the Tree of Life, the True Vine. We are branches on that vine – as long as we are connected to Him, we bear Fruit. That fruit is not for ourselves, it’s for others. The Tree of Life is in the Garden, God’s garden. The Garden is inside the walls of Heaven… The Book of Revelation says the gates of Heaven never close.
Now, Jesus assures us that one cannot see (perceive) the Kingdom of Heaven unless he/she is born again. So what if the Fruit on the Tree attracts everyone (EVERYONE). The Fruit contains seed and is planted in the heart of the one partaking of it. All are free to come and go as they please and, eventually, all will permanently take up residency where they find the fruit most appealing.
(Came to me on the drive home)