Although building a flat array of tokens is _one_ use-case for TokenGen, this new approach means we can also use the interface to write to an io.Writer without needing to produce an intermediate buffer.
Although building a flat array of tokens is _one_ use-case for TokenGen, this new approach means we can also use the interface to write to an io.Writer without needing to produce an intermediate buffer.