If God were harsh and demanding and everywhere, it would make sense to try to forget His presence. If He were compassionate and comforting and everywhere, it would make sense (always and everywhere) to practice remembering.
“God is here. There is no place, there can be no place, where He is not.” A. W. Tozer
“[T]he Father of compassion and the God of all comfort. . . .” 2 Corinthians 1:3