Drop unsupported versions of Django

[WhyNotHugo]

https://endoflife.date/django

And trim down the CI matrix; we test way too many combinations.