FAF is not reporting games correctly

[FunkOff]

It's becoming increasingly evident to me FAF does not record ranked games correctly. Incorrect or non-reports are at least a quarter of all games, as best I can tell. As Zep has pointed out, there are numerous problems with the overly simplistic return that FA gives to the client and this, itself, is the cause of many problems. However, I have a rather novel solution to the problem:

Ask the player what the result of this game was.

Whenever the game client is closed, ask the player to report what happened, then have them click a button: Win, loss, draw, desync/disconnect. In the even both players pick the same thing, take that and compare it to the results to help improve the systems accuracy. If not, take the system-generated result as truth and note it as a disagreement. Keep records of the player's disagreement %.

This isn't a perfect system... players will lie... but this will improve accuracy above that of the current system. Again, this is because it will take players' word if they agree, and take the system word if they disagree. It is unlikely, because they have incentive not to, that any two players will willingly give false results that equal each other. At worst, this system will do what the present system does.

Zep, others, thoughts?

[Ze_PilOt]

A quarter of games seems really a lot.
I really want to know when it happens, just after the game if possible, and with the name of the opponent, the map and the excepted result. Otherwise it's nearly impossible to find the game in the logs

Saying that something is not working in the chat will *not* help me debug the thing. Chances are that I will not see that.
Tell me in PMs, on Aeolus or here !

Again, if something is not reported to me, for me it's working correctly ! That's why I'm suprised by you saying that 1/4 game are reported incorrectly !

I'm suprised because it should be correct like GPGNet now. Even they were errors pretty often in GPGnet too

- Non report
If someone doesn't disconnect, the server still think they are in game. The game will be reported after that person host a new game or relog to FAF.

- Incorrect results
Sadly, FA sends incorrect result a lot more than you can expect. I have some modifications ready in the lua for avoiding that. Didn't had time to test yet.

[Moritz]

thats why I parse replays and have 100% correct results.

[Ze_PilOt]

I've looked at the game that doesn't get reported correctly, with the same result ..
I remember having these kind of problem on GPGNet too.

[FunkOff]

Well, two games were reported incorrectly last night, here's the info:

5 september, Spindrah v FunkOn, Isis, (actual result) FunkOn win, no score update, no server score given in chat
5 september, Spindrah v Barry_Soetoro on Roanoake's, (actual result) both lost conn to each other, barry given defeat

[Reddev32]

3v3 Twin rivers 06/09/2011 @ 16:30 Game start

Players,
Me, Miruzuki, Cobrand, Rae83, Leshaadv, Syava.

I killed 2 acus and Mir 1 kill Cobrand 1 kill

[Ze_PilOt]

Well, two games were reported incorrectly last night, here's the info:

5 september, Spindrah v FunkOn, Isis, (actual result) FunkOn win, no score update, no server score given in chat

Found the game :

Code: Select all

09-06 03:39 FAGame SpinDrah -  DEBUG    Game outcome  : SpinDrah : Defeat, FunkOn : Victory,
TS 1vs1 Results
FunkOn : original score : mean=1832.8101, standardDeviation=79.1207
mean=1834.9080, standardDeviation=78.9146
SpinDrah : original score :  mean=1194.0154, standardDeviation=126.8680
mean=1188.6344, standardDeviation=125.4662
found players online


The game counts, result is correct, and the results are send. Must be a lobby problem.

5 september, Spindrah v Barry_Soetoro on Roanoake's, (actual result) both lost conn to each other, barry given defeat

Code: Select all

09-06 05:08 FAServer     DEBUG    SpinDrah Vs Barry_Soetoro
DEBUG    SCMP_020

TS 1vs1 Results
SpinDrah : original score : mean=1154.0502, standardDeviation=118.0903
mean=1217.5564, standardDeviation=113.4244

Barry_Soetoro :original score : mean=1592.7303, standardDeviation=86.0205

mean=1558.9799, standardDeviation=84.3348

found players online
Game finished - Removing game

Correct too. Barry_Soetoro disconnected from the server, but spindrah stays, so the game count as a loss for Barry_Soetoro. (otherwise, it's easy to pull the plug to avoid a defeat)

[FunkOff]

Are you sure about the barry vs spindrah game? I was watching the replay, and when the game DCed I checked chat and both players were there. Barry told me he ejected Spindrah in the in-game connection manager after 1 minute, Spindrah said he did the same after 1 minute and 5 seconds.

[Ze_PilOt]

I'm pretty sure.

Here is the log of Barry disconnection :

Code: Select all

09-06 05:20 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:20 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '5829.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '11829.5']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '17698.6']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '23095.8']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '29095.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '35095.4']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '41095.2']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '46261.8']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '51675.1']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '56675.1']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '62674.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['BottleneckCleared']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [[]]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['GameResult']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [[2, 'defeat']]

Bottleneck is connection problem (packet not received).
I can check but I'm sure that player 354 is Barry.

Then the cleared (kick out of game), then SpinDrah send Barry result (defeat).
Barry never sent a Bottleneck or a result, so the server is taking SpinDrah as the only one in game.

[FunkOff]

Oh okay. Hmm. Can you please add an in-game notification for disconnects? Perception is a big deal... Barry and Spindrah both thought FAF just messed up (and I sort of did too) because neither of them got warning and Barry certainly did not get a notice that he was having connection troubles. If he did, at least it would help him understand that the system was not simply being unfair.