SelfSearch is a reward-free search procedure for self-improving LLM agents. It modifies agents using records of previous self-improvement episodes, capturing reasoning, tool actions, and outcomes. SelfSearch improves population-mean success and reduces execution cost, achieving competitive task success at lower search cost.