Many call these screw cap vinegar bottles, but they're also called decanters, milk bottles, etc. They came in a custard color as well as milk glass & were made in the thousands as a popular souvenir of the New York Worlds Fair.
It's unusual to find them with the original screw on top.