You need an external reference like an RTC or a good crystal, no other way.
You could use the RFM69 crystal and LISTEN_MODE to wake up, that saves power and is more precise, some guys have made that work in this forum. But I don't know how you'd count the elapsed time with that method either. You just need a reference I guess, maybe others have some novel ideas.