Well I had actually played with using Sugar initially, and while Sugar is nice, it was a little too robust in some areas and lacking in others for our needs. We have a certain sales model that is basically "hit and run" (We move quickly from client to client with short sales loops instead of detailed and long sales processes, just the nature of the product) so we needed something that matched our model and was finely tuned for how we work.
I personally feel like CRMs are just like CMS systems for developers. Yes, there are good solutions out there for your initial build, but eventually, it's better to build your own to get exactly what you want. You shouldn't compromise anything for your business in my opinion.