Klipper should compile and install along with the kdebase package, and appear on your KDE panel (Kicker) when you run KDE 2.
If you do not want this to happen, simply remove the reference to Klipper from your $KDEDIR/bin/startkde file