It was the same with me when I returned. I think you'll find that your memory will return more quickly once you encounter the people in question.

[His eyes soften slightly.]

... and there are some people you never really forget.