Your speaking about traveling outside your body. I did that when I was little too. Very little maybe 4 or 5. Speaking on past lives there is a finite number of souls so alot of people have been here before and have past lives. I call it the spirit and soul recycling center.
when it happened to me when I was very small I was not scared at all. I didnt feel like I was going to die. I was flying around in the universe. I left this planet. It was cool.
This is not my belief , but it is a great story . Two beings , God and a human that is ever one else . The Egg The forum where this link was posted and a discussion . http://www.astralpulse.com/forums/welcome_to_astral_chat/the_egg-t42724.0.html
Just because it never happened to you doesnt mean that it doesnt happen. There are plenty of people who have had out of body experiences. They believe it because it happened to them and there are people who have studied people who have had them and they have never had that experience themselves but know it happens.