The less desirable part of town. In many 19th- and early-20th-century America, railroad tracks divided a city or town. On one side was the middle- and upper-class residential and commercial area. On the other were factories and residential shacks and tenements. Since residents of the former made class distinctions and applied appropriate language, anyone from the other part of town came from the wrong side of the tracks.