You cant realize you've forgotten something until you remember it. Think of how many things you've forgotten and never remembered.

This is what death will be like. Everything forgotten, and never remembered.