http://www.treasurydirect.gov/NP/BPDLogin?application=np
This site records debt to the penny, daily. There's a fair amount of up and down in such a measure, as you might expect. There are certainly (long-ish) periods during Clinton's presidency where the total debt, as well as debt held by the public, decreased from the day at the start of the period to the day at the end.