Lowest portions

....long walks, which appeared to take him (Sherlock Holmes) into the lowest portions of the city.

(
This would refer to the less well-to-do areas of London)