I hate to disappoint you, but there's no way to get the Judge back. You're going to have to deal with the evil Joey instead.
You will first have to listen to Joey's long speech first. You may use the turns when he first appears to prepare your attack.
By himself, Ernie is actually quite weak.