← All projectsGitHub
Self-replicating manufacturing

Is the dynamic-programming table for the replicating shop with a resale value converged, and can its policy be trusted?

research/selfrep-dpgrid

Grid-convergence check of the terminal-value DP: the policy's value is stable to about 0.15% from 800 to 1,600 grid points while the table value rises from 8–13% (400 points) to 2–3% (1,600) below it; a stylised fluid model, preliminary.

4 tests

What it found

Follow-up to selfrep-terminalmarket, which found its DP table up to about 10% below the value of its own policy. This project refines the log-spaced fleet grid from 100 to 1,600 points and tries a second interpolation rule (linear in fleet size instead of in log fleet size), on the same fluid model (W = 50 h, failure 0, horizon 600 h, all inputs assumed). The simulated value of the DP policy changes by only about 0.15% between 800 and 1,600 points and stays within 0.2% of the best bang-bang switch, while the table value approaches it from below roughly in proportion to 1/(grid points): about 8–13% low at 400 points and 2–3% low at 1,600. The table is therefore a slowly converging lower bound, not a certificate; a first-order extrapolation puts it within about 0.8% of the bang-bang value in the three cases tried, but that rests on two grids. The cause of the bias is not diagnosed. Stylised fluid model, preliminary.

A figure from its own output

Figure produced by research/selfrep-dpgrid: gap
selfrep-dpgrid/experiments/gap.svg, written by the project's own experiment code.

Paper, code and results

More in Self-replicating manufacturing

All 34 Self-replicating manufacturing projects →

Other research topics

Proper scoring & elicitation28Effort & peer prediction9Verification games & slashing19Detection & tolerances14Markets as routers13Prediction-market design9Paying contributors8Decentralised training systems23Digital twins & sim-to-real164LLM chip design loops40Robot manufacturing loops53Ambient AI assistant46Self-replicating manufacturing34Simulation-first design64Engineered clothing45Task-specific AI accelerators40Algorithmic chip-design loops42Open-source purpose-built robots44The software-engineering loop43Adversarial human imitation41Open-source residential construction41Autonomous multi-angle capture34Sensing, imaging and 3D31Energy supply and dense energy storage39Robot societies among people31Agentic co-design of low-cost robots27Laundry-hanging robots25Machine learning on qualitative data23Robots on the building site27Civilizations & group psychology1History & human sciences1

Produced with AI assistance (Claude). Results are from the code in this repository and are simulated or stylised unless the abstract says otherwise; nothing here implies affiliation with or endorsement by any lab, researcher or company cited. MIT licensed.