There is a growing push to oust California Democratic Congressman Eric Swalwell from the House Intelligence Committee after accusations have surfaced he had dealings with a Chinese operative.

Indiana Republican Jim Banks is among the contingent of House Republicans pushing for his removal from the committee. He signed onto a letter from the contingent to House Speaker Nancy Pelosi about it.

“Rep. Swalwell withheld information for five years from the House Intelligence Committee about an ongoing Chinese espionage operation targeted at him and his own colleagues,” the letter said.

A report from Axios revealed this month that Swalwell had worked with a Chinese spy named Christina Fang, or Fang Fang, who helped him raise money for his 2014 congressional campaign.

Swalwell is not accused of any wrongdoing, but as a member of the Intelligence Committee, which handles sensitive information, Banks told Fox Business on Thursday that House Speaker Nancy Pelosi should remove Swalwell from the committee.

Republicans are also pointing out that Swalwell was a leading member of the push by congressional Democrats in the Russia Investigation, all while not saying anything about his possible ties to a Chinese spy.

Speaker Pelosi has said she doesn’t “have any concerns” about Swalwell retaining his seat on the House Intelligence Committee.

“One thing that Democrats have been completely honest about, is that the Democratic Party is the pro-China party,” Banks told Fox Business. “They’ve altogether dismissed the greatest adversary, the greatest threat that we face in American today which is China, who seeks to dominate us militarily and economically.”

Swalwell has sidestepped questions on the calls for him to step away from the House Intelligence Committee from reporters on Capitol Hill.