DealForge autonomously sources, scores, and writes investment memos on venture deals. Stop manually hunting.
1,180+ deals tracked · 22 AI investment memos · Updated daily
Show HN: Terminal-Wrench, a dataset of 331 realistic hackable environments
I want to share a new dataset of 331 reward-hackable environments. These are real environments used in Terminal Bench and adjacent benchmarks. I first got interested in this because, as a reviewer of Terminal Bench, I noticed a lot of our tasks were hackable. I also noticed that many contributors to the benchmark do so because it provides credibility when selling environments to labs. Hence, TBench tasks are, in my opinion, held to a higher quality standard than those being used today for RL. No one is spending hours manually reviewing the $1B in tasks being purchased by major labs. As far as I understand, while everyone knows environments are hackable, nobody has released hundreds of "realistic" environments.
Terminal identifies a high-value gap in the RL training market by exposing the low quality of commercially sold environments through a dataset of 331 hackable scenarios. While the founder demonstrates deep domain expertise as a benchmark reviewer, the project is currently a research contribution rather than a scalable business, facing significant execution and monetization risks.