ManiMage.ai

0:00 / 1:48

Agentswhen words become actions

Frontier AIStop 9 of 101:48

Some words are commands. Think → act → observe, with the context window as working memory.

This opens up

Nothing yet. No lesson builds on this one so far.

Transcript

It follows the voice. Click a sentence to jump there.

Everything a model emits is text. But once we agree that certain strings count as instructions, emitting text becomes doing things. One line is ordinary thought: check what videos exist. The next line is a command, waiting for something to execute it.

That agreement produces a loop. The model thinks and emits a tool call. The environment — everything outside the model — executes it. Whatever comes back gets added to the end of the context, as text the model can read.

It reads what came back and thinks again. Think, act, observe — lap after lap, until the task is done, or the model decides it is.

A tool is anything with a text interface. Search the web, run code, edit files, drive a browser. If it takes text in and hands text back, it plugs into the loop.

The context window is now the agent's working memory. The task, the thoughts, the calls, the results — laid end to end in one sequence. The machinery underneath is unchanged: the Transformer reads everything so far, predicts one next token, and that token feeds back into the context. Agency, built out of autocomplete.

This series is proof. A language model sat in this loop, with a terminal and a renderer for tools, and wrote, rendered, and revised every one of these lessons. The words a model emits became commands, the commands became actions, the actions became these pictures. Agency was autocomplete all along.