Paper: Program-as-Weights: A Programming Paradigm for Fuzzy Functions
Listen to this article.
Problem
Many common programming tasks—like sifting through log data, fixing messy JSON, or ranking search results—don’t easily translate into rigid code and are often handled by sending requests to large language model (LLM) APIs. While convenient, this introduces issues with data privacy (sending information externally), reproducibility (API responses can be unpredictable), and cost (every request has a price).
Method
The paper proposes a new programming paradigm called “fuzzy-function programming.” The core idea is to compile these fuzzy tasks – those not easily captured by rules – into small, self-contained neural artifacts that can run locally. They achieve this with Program-as-Weights (PAW). PAW uses a relatively small 4B compiler trained on a new dataset called FuzzyBench (containing 10 million examples) to generate efficient “adapters” for a smaller, frozen interpreter (Qwen3 at just 0.6B parameters).



