A local sheriff's office in New York is facing heat from federal agents after an illegal migrant was released from the facility despite having a federal deportation order.

Jesus Romero-Hernandez, 27, on Tuesday pled guilty to third-degree assault charges in Tompkins County. He was released by the local sheriff's office even though he had a federal arrest warrant, according to the Justice Department.

Acting Deputy Attorney General Emil Bove said that Romero-Hernandez was caught by federal agents Thursday and slammed the county sheriff's office for not keeping him in custody. 

“The Tompkins County Sheriff’s Office in Ithaca, NY, a self-described sanctuary city, appears to have failed to honor a valid federal arrest warrant for a criminal alien with an assault conviction,” Bove said. 

County Sheriff Derek Osborne could potentially face prosecution for allowing the release of Romero-Hernandez, according to The New York Times.

Federal officials said that Romero-Hernandez was deported in the past but returned to the U.S. at some point.

"We will use every tool at our disposal to prevent sanctuary city policies from impeding and obstructing lawful federal operations designed to make America safe again and end the national crisis arising from four years of failed immigration policy," Bove said.