There are some libraries that can extract keywords that don't require a call to GPT. I wonder if those would be cheaper and work?

Thanks for the idea, the cost wouldn't be a lot smaller because the question summary doesn't consume so many tokens compared to the context, however the latency would be improved significantly if we avoid one round-trip.