The track into the downtown area on my layout, the Trenton Subdivision in N Scale is laid and ballasted. I removed several sidings to give the area a simpler, less cluttered look. More below. 
 

The engine siding remains and is long enough to park a switcher engine, caboose (if needed) and provide overnight staging for the RDC that services the branch line. Three businesses/industries can receive cars, Innes Tartan and Textile, CN Express Frieght and the Mott’s Clamato plant has a double siding. 

 I prefer to ballast the track after it is laid as it secures and stabilizes the track. I can then take my time and work out the position of buildings and green spaces. I will eventually run greenery over the ballast, giving the effect of encroaching weeds.