Levites Numbers 35:2 "They shall give cities to the Levites from the inheritance of their possession to dwell in"

The Levites represent us in the Beit HaMikdash, performing the service of HaShem. That is their "inheritance" and special privilege.

It is our duty to provide them with cities in which to live, taken from the land given to each tribe. In this way, the Levites can live among us and teach us how to serve G‑d in the best possible way.