And David dwelt in the castle; therefore they called it the city of David.

So David took up residence in the fortress; that is why it was called the City of David.