So... losing a territory, whether through battle, abandonment or timeout. It has been established that you keep the building levels so long as the same planet links to another territory of the same type. It has been established that you lose any ships that are sitting on the territory. What about workers and defenses? Do those come back when you link up again, or are those lost each time the territory is unlinked from the planet?