Do archived lists affect the total number of contacts?

No. The number of contacts included in your database is not related to the lists that are contained in it. Your contacts could be included in one, many or no lists at all.
To access your actual total leads number, use the All leads filter.