Plague (Yersinia pestis) probably contributed to neolithic decline 5,300y ago.

Link. In a Scandinavian sample 1/6 had active infections at time of death and that probably understates mortality. The 541AD Justinian plague killed about 40 million and contributed to collapse of Western Europe.