OK, so CivStats doesn't show you with a score bump, so I'm assuming that you haven't finished the build yet. In which case, you would just need to log back in and switch out the build and no-one else needs to replay.
The end of turn button just indicates to the game that you are ready for the turn to roll, there is no restriction on making changes, whipping, even moving troops, etc. after it has been hit.