You're conflating two meanings of the English word "once": "happening one time" and "at some time in the past". (The two meanings are probably related etymologically, but they're distinct now.)
This reminds me of the use of a similar expression in the Jātaka tales. "We were brothers once (one time, in one of our many former lives)."