Are you, in fact, a pregnant lady who lives in the apartment next door to Superdeath's parents? - Commodore

Create an account  

 
Civ4 AI Survivor: Season Three

I did finish the Alternate Histories #2 report that I mentioned working on a few weeks ago. There's some interesting data here about what happened when I played out the same map repeatedly with a collection of terrible AI leaders.
Follow Sullla: Website | YouTube | Livestream | Twitter | Discord
Reply

Thanks for posting this, Sullla! Very interesting results, seeing the same trends repeat in most of the games.

It is remarkable how poorly a leader like Willem performs, despite having very strong traits. The importance of the less obvious AI leadeer characteristics, like military unit emphasis and research focus, becomes apparent in these matches.

I do wonder about Hannibal's performance on this map, and how much impact his starting position and lack of room to expand had compared to his traits. That his results were the most variable adds to my curiosity about how the same set of leaders would perform on a different map.
Reply

(April 28th, 2018, 17:42)haphazard1 Wrote: Thanks for posting this, Sullla! Very interesting results, seeing the same trends repeat in most of the games.

It is remarkable how poorly a leader like Willem performs, despite having very strong traits. The importance of the less obvious AI leadeer characteristics, like military unit emphasis and research focus, becomes apparent in these matches.

I do wonder about Hannibal's performance on this map, and how much impact his starting position and lack of room to expand had compared to his traits. That his results were the most variable adds to my curiosity about how the same set of leaders would perform on a different map.

IMO the map plays a way bigger role in successes than the leader (edit: leader's preferences, not counting peace weight which is kind of "part of the map"). There are some freaks like Mansa* that can be the tech leader with 4 cities, but give Sitting Bull 25 cities and he'll win the game. Put a super cramped Monty next to SB who has tons of room to expand and SB probably wins that. (Of course no one would be surprised if he somehow managed to lose.  rolleye) Without re-looking at the maps, I'm guessing that's the reason idiots like De Gaulle did well. And also why the "average" civs that are just sort of solid tend to have their moments of glory. Stalin, Kublai, Qin, and many other forgettable leaders...  all pretty well rounded and just waiting for their chance. Even De Gaulle has an obvious path to victory with his personality.

The map variability and people's skill at reading it adds most of the excitement to the streams, so it wouldn't make sense to do a perfect circle Finals map for every game, but that would certainly help things like Hannibal getting screwed by the map. And even then you get the peaceweight screwing over certain AIs. Fredrick can easily win a culture victory if he's sitting behind a friendly and helpful Kublai. Mansa had basically no chance in the finals.

*Minor note, He should really be referred to as Musa, not Mansa. Mansa was his title. Same with how Sullla always refers to Ghengis as Temuijin I suppose.
Reply

The map is certainly a big factor. It would be very interesting (but a lot of work) to take a game such as the one Sullla just ran the alternate histories for, and shuffle the start using World Builder to exchange the positions of the AIs. Put Shaka in Hannibal's position, Toku in Isabella's, etc., and then run the game. How much would change?

Some things would still be similar -- Frederick having big peace weight differences from most of the field, and Isabella founding a religion and hating everyone who does not adopt it, for example. But which AIs are next to the warmongers, and which have more space, would change some of the trends.

It is not really practical to control for all possible variables -- there are just too many of them in Civ.

Hmmmm, wild idea. Map with half a dozen instances of the same leader, and see what happens? Is that even possible to set up?
Reply

Thanks for doing the extra report Sullla, very interesting stuff.

Definitely good evidence for the case that - while there can be occasional outlier results - over multiple games the same "weak" civs will always tend to get weeded out of the competition, while the same "strong" civs will tend to remain. Of course, sometimes the brackets happen by chance such that there's an extra-lightweight game (weak leaders breeze through on easy mode) or an extra-tough one (inevitably dooming a few otherwise tough contenders to early elimination). And occasionally the layout of the map might favor or hinder certain civs significantly more than average - though reading the map is a large part of the fun, so I wouldn't suggest making everything a donut.

Are you planning on running Season 4 this year? Pretty keen to see how the predictions improve (or not!) next time around based on the existing data.



haphazard1 Wrote:The map is certainly a big factor. It would be very interesting (but a lot of work) to take a game such as the one Sullla just ran the alternate histories for, and shuffle the start using World Builder to exchange the positions of the AIs. Put Shaka in Hannibal's position, Toku in Isabella's, etc., and then run the game. How much would change?


Permuting the starts in some of the test games would certainly be interesting to see. I suspect victory probability is somewhat correlated to starting location. Enough perhaps to reliably switch the victor between two similarly strong contenders over a statistically significant sample of games. Probably not enough though to switch the victor between a strong contender and a weak leader. Unless we're talking about an exceptionally poor start.

haphazard1 Wrote:Hmmmm, wild idea. Map with half a dozen instances of the same leader, and see what happens? Is that even possible to set up?

Sure it'd be easy enough to set up. Might be tricky to deal with the notifications though!

"Gandhi has declared war against Gandhi - Gandhi has joined the war against Gandhi - Gandhi has made peace with Gandhi"  eek

I'm guessing you'd want to rename them. :P
Lord Parkin
Past games: Pitboss 4 | Pitboss 7 | Pitboss 14Pitboss 18 | Pitboss 20 | Pitboss 21
Reply

Leader names can be edited in the Worldbuilder file, that's not a problem

Frankly, the only annoying part would be pressing Enter a billion times, especially if you want to run multiple simulations. If there's a way to make the game run without asking the user to press Enter every turn, I couldn't find it, but it would make survivor style games so much easier.....
Reply

(May 2nd, 2018, 03:21)Lord Parkin Wrote: "Gandhi has declared war against Gandhi - Gandhi has joined the war against Gandhi - Gandhi has made peace with Gandhi"  eek

You missed "Gandhi has nuked Gandhi". smile
Reply

(May 2nd, 2018, 04:42)rho21 Wrote:
(May 2nd, 2018, 03:21)Lord Parkin Wrote: "Gandhi has declared war against Gandhi - Gandhi has joined the war against Gandhi - Gandhi has made peace with Gandhi"  eek

You missed "Gandhi has nuked Gandhi". smile
What about Gandhi voted for Gandhi in AP elections?
Reply

(May 3rd, 2018, 11:16)LKendter Wrote: What about Gandhi voted for Gandhi in AP elections?

Gandhi voted for Gandhi, defeating Gandhi, while Gandhi abstained. lol It would get confusing.
Reply

Hey all,

I also tested some alternate plays, care if I share here? 


Season3 Game 5


I tried 6 games to see if I actually deserved 0 points from the contest, turns out I did... 

[Image: 27fc694d901520aac1d6e4b06bb576b0-full.jpg]
[Image: 37786114ab8b3380862459ce45a98583-full.jpg]

[Image: 5019070f28f609bb81f62a41d96b6f91-full.jpg]
[Image: 6cf6fe19952e8cc9f948aec472fdd5e1-full.jpg]
[Image: af55829cb1c49c564cfdcd7c408deff2-full.jpg]
[Image: 16ca94b394870c1b9224c082800d246c-full.jpg]


6 games results
Lincoln
3 First Place 
2 Second Place
1 Fifth Place
1+1+1+2+2+5=12
Mansa Musa
2 First Place
2 Second Place
2 Third Place
1+1+2+2+3+3=12
Hammurabi
1 First Place
2 Second Place
3  Third Place
1+2+2+3+3+3=14
Gilgamesh
1 Third Place 
5 Eliminations
3+10+10+10+10+10=53
Suleiman
1 Fourth Place
5 Eliminations
4+10+10+10+10+10=54
Alexander
6 Eliminations
10+10+10+10+10+10=60


Season3 Game 6


Power of starting positions
[Image: d0e1a8fe65836337c858f885eec9ee25-full.jpg]
[Image: 4ee1fd0bb60ac6469801be310c506b40-full.jpg]
[Image: 6a26aa096180857b4aa793736092880a-full.jpg]
[Image: 92c7ed5f9b86927bcc5b61127a83f984-full.jpg]
[Image: 2172deeee7a479967855882a1795bd58-full.jpg]
[Image: 3eb064c5c1256dd98b2b403b2a807a2b-full.jpg]
[Image: 89c3498aa1665ddbe99038df69d4c451-full.jpg]
[Image: 03b805807c9ed83576dd1ccb8affa6dd-full.jpg]
[Image: 450e6428da64e0581a315838a500f6a5-full.jpg]
[Image: 5baa6637a9ca4a6fdf25dbab6f908c58-full.jpg]
[Image: 13f3cc2de6d754b69ff93956c0569124-full.jpg]



Elizabeth
8 First Place
1 Second  Place
2 Elimination
1+1+1+1+1+1+1+1+2+10+10=30
Brennus
3 Second Place
2 Third Place
3 Fourth Place
1 Sixth Place
2 Elimination
2+2+2+3+3+4+4+4+6+10+10=50
Zara Yaqob
1 First Place
3 Second Place
2 Third Place
2 Fourth Place
3 Elimination
1+2+2+2+3+3+4+4+10+10+10=51
Julius Caesar
1 First Place
3 Second Place
1 Third Place
2 Fifth Place
4 Elimination           
1+2+2+2+3+5+5+10+10+10+10=60
Qin Shi Huang
1 First Place
3 Third Place
1 Fourth Place
2 Fifth Place
4 Elimination
1+3+3+3+4+5+5+10+10+10+10=64
Cyrus
2 Third Place
3 Fourth Place
2 Fifth Place
1 Sixth Place
3 Elimination
3+3+4+4+4+5+5+6+10+10+10=64
Pericles
1 Second Place
1 Third Place              
2 Fourth Place
1 Fifth Place
2 Sixth Place
4 Elimination
2+3+4+4+5+6+6+10+10+10+10=70

Basically same things happen over and over but with small surprises that change the results. Julius Caesar can't stand Brennus and pretty much he made everything for Elizabeth to win unlike what we had in survivor, fortunately. We should take a look how fair the starting positions are, aparently there are very big differences, I blame tropical climate. Speaking of which tundra and rocky are left out right now, maybe Sulla makes tundra for season 4 this year parallel to Russia world cup?  :crazyeye:

I don't think Willem is weak, and Tokugawa is just lucky in that starting place. To alternate even more we should swap starting positions but I rather see more and more seasons with different maps to ever come to a conclusion.
Reply



Forum Jump: