Were you researching archery at all?
I think the city you settled had two major problems. It did not provide you with a strategic resource to defend your self with and it was a weak city prior to border expansion. You second city cannot be this bad early on. It's required to feed the snowball. Eventually the city would have been strong but eventually is far too late.
You also pissed us off with the settlement. But that is a lesser issue. Had you had two axes or archers in the city we would have had no choice but to swallow it for the time being.
For general play, I think you needed a second worker earlier. Not sure exactly when. Admittedly, your start was not easy due to the necessity/utility of Animal Husbandry. Perhaps the start required a Hunting + Mining Civ. You could have settled the horses though.
Did you miss the road on your deer tile? It's customary to delete workers that can't be saved from capture.
Sorry for all the criticism but this was really badly played on your part.
Getting trounced in the first Pitboss is pretty normal though. Amicalola died to a war chariot rush in his first game and he recently won Pitboss 60 in dominating fashion. Good luck in the always war game.