Things like this are optimized into build orders. So just dont take stone / gold that early if you dont need it already.
Also you need the wood for buildings to advance to the next age and build farms for after sheeps / boars runs out. In Dark age you mainly wants food to create villagers. So gather the right resources to be able to buy what you need. Things like: Dont have an idle TC, but create villagers all the time. It is all about doing things as efficient as possible. On open maps you can even expect an army in feudal age or even in dark age. This looks like a good Fast Castle build into some pressure.
