One of the local coffee shops solves this problem by also being a music school: http://hometownrhythms.com/

They also have regular musical acts. The Athens/metro Atlanta area has a lot of cover bands.