Everyone discusses the spring tension and that's true, but I think most people miss what I consider to be even more important issues: the sloppiness of the factory system (doohickey fitting the idler shaft loose, factory spring preloading the loose doohickey to the 'wrong side' of the flats) resulting in a system, that even brand new, 'rattles around' and beats up the balancer system components.
This is what I've posted at my site about this, I'll copy and paste it here.
"On ALL model years of the KLR, I believe an Eagle doohickey and torsion spring should replace your stock components. The function of this lever and spring is to properly tension your counterbalancer chain, which is being driven by your crankshaft. If you think about it, the crankshaft is decelerating a little on the exhaust and intake strokes, decelerating a lot on the compression stroke, and accelerating a LOT on the power stroke. This is actually a significant torsional input to the system with every revolution of the engine, which means that the counterbalancers and water pump are also accelerating and decelerating with every engine revolution. Now put a loose chain or sloppy system between these two into the equation and you can see why things get beat up if they are not properly tensioned. Gen 1 levers broke or cracked, Gen 2 and Gen 3 levers are much stronger but have a spring which runs out of tension in a short distance (around 5,000 miles is common), and ALL factory levers have a sloppy torsional fit onto the idler shafting. Thus, even when bolted down from the factory, the stock balancer system is rattling torsionally within the lever with every engine revolution, which over time, beats up the torsional fit in the lever (especially the Gen 1 bikes) and in all cases, beats up the rubber on the balancer sprockets. After running out of tension from the factory spring (most prevalent on the Gen 2 and Gen 3 bikes), this wear accelerates. The factory extension spring stinks, period. It's job is to rotate the doohickey to keep the balancer system tensioned. Of course, Kawasaki should use a torsion spring to rotate something... but they don't. They pull on the side of a separate lever, which has two problems: one, this could never turn the separate lever very far because the load application angle never changes, and two, it preloads the factory doohickey against the loose side of the flats on the idler shaft, guaranteeing the maximum torsional rattle discussed above. The Eagle Doohickey fits the flats on the idler shaft with much less slop, PLUS the torsion spring actually applies torque directly to the doohickey, NOT a sub-lever. Thus the doohickey is always preloaded to the "tight" side of the flats on the idler shaft. Win-win."
I think this slop is a primary problem, but it is almost always overlooked in doohickey discussions. All I can add to this discussion is that I have over 200,000 miles on my KLR with an Eagle doo and torsion spring, and have had zero issues with all the components. Hope this helps. I'm headed out in August on another multi-state ride, far from home and am not worried.