You should be able to buy a Thinkpad T61 from IBM with Linux already installed on it (RHEL, IIRC).

I'm contracting at IBM now and pretty sure we sell these to customers as Linux desktops (IBM Ubuntu and RHEL 5 OpenClient are the SOE for my team).