“you can prevent Mail from crashing unexpectedly by quitting and relaunching the app after you work in the Previous Recipients window”

Link. I edit Previous Recipients every year or two.