The former agent was identified as James Smith.
He was being held in connection with his former job, sources said, but the charges were not immediately available.
Sources said Congress was being briefed on the arrest before it is announced to the public, which was expected to happen later today.
Department of Justice officials declined to comment on the case.
Smith retired from his job in the bureau’s Los Angeles office in 2000 and was in charge of Chinese counter intelligence.