What should I optimize?
This isn’t rocket science. It’s basic data science.
“Should I optimize my models?”
Yes, if your model provider lets you
“Should I optimize my harness?”
Yes
“My context?”
Yes
“This is a lot of work”
Yes
“Where should I start?”
By looking at your data and identifying the layer that can improve the most common set of errors
—
This a cross-post of a tweet given all the hype about optimizing harnesses. I’m always happy to chat about tactics that might be suitable for whatever you’re building.