Assembly Speaker Sheldon Silver is taking a leave of absence from the law firm where he is “of counsel” as he fights his five-counts of corruption stemming from legal referrals federal law enforcement says were actually bribes and kickbacks.

“I will be taking a leave of absence from Weitz & Luxenberg, effective immediately,” Silver said in a statement. “I am grateful for my time with the firm and do not want the pending and unwarranted allegations against me to be a distraction, especially since there was no wrongdoing by the firm. I wish the firm and its lawyers well as they continue their outstanding work on behalf of their many clients.”

Silver has received more than $5 million in payments from the firm over the last 14 years, where it has long been scrutinized over what, if any, actual legal work Silver performed for the high-powered firm.

As Silver fights for his future as speaker of the Assembly, Weitz & Luxenberg is publicly distancing itself from Silver.

Silver is yet to announce his resignation as speaker.

“We were shocked to learn about the allegations against him of impropriety in the referral of cases to our firm,” Perry Weitz, the firm’s president, said in a statement. “We have asked Mr. Silver to take a leave of absence until these allegations are resolved.”

The firm’s statement also pointed out that it had no knowledge of Silver’s referral activities.

Silver is expected to vacate the speaker’s chair by Monday, at which point Majority Leader Joe Morelle is exepcted to become acting speaker until an election on Feb. 10.