It only shimmies when you are braking, no other times?
Checking for worn idlers is easy. Just get under the front of your van, grab the centerlink and push up on it and pull down on it. If the idlers are good, you will not see or feel them move. If they are bad, it will be obvious.