Blender 3D might be one of the more well-known success stories in that regard. Godot game engine also perhaps? Gotta be more'n a few others as well, I'm sure. Those are just two that instantly come to mind for me (being a couple of my favorites that were both closed source at one time in their history and have gone on to massive and continual success since their open sourcing).