U.S. Bureau of Alcohol, Tobacco, Firearms and Explosives spokesman Richard Coes tells The Associated Press that the weapons were taken from a CSX rail yard along Marietta Boulevard, on the city's northwest side.
Coes said they include "AK-style" rifles. He declined to discuss other aspects of the case.
Gary Sease, a spokesman for Jacksonville-based CSX Corp., said the company is cooperating with law enforcement to recover the weapons.
CSX said in a statement the company is working with law enforcement officers in "a rigorous investigation led by them."
Authorities said the rifles were stolen on or around Nov. 12.