A conservative Wisconsin Supreme Court justice said Thursday he will not participate in a pending case that will determine whether tens of thousands of public sector workers regain collective bargaining rights that were taken away by a 2011 law.