Michael Chung, 52, who reportedly has extremist views, sent a letter to a Sovereign Bank in Pottsville, which read, in part: "The 2nd Amendment to the National Constitution authorizes the use of deadly force to protect my interests as a national citizen," the station said.
Chung reportedly had a loan with the bank that was preventing him from selling his home.
The man has a shotgun registered in his name, NBC said, but it was not immediately clear if the gun was still in his possession.
Chung allegedly considers himself a "sovereign citizen," meaning he does not believe he is obligated to follow federal laws or pay taxes.
He was scheduled to be arraigned in Brooklyn Federal Court Wednesday afternoon, the FBI said.