My opponent gain time I lost every move

I was up on time and then all of a sudden I'm loosing. Any explination. I was loosing 2 seconds sometimes 1 per move even though I was moving quickly.

My opponent except for the first few seconds was also moving quickly except he was gaining time while I lost seconds per move?

Some weird bug? Any ideas

Is this gamemode King Of The Hill? If so that's why the goal of King Of The Hill is to get the king on e4, e5, d5, or d4 which is why the game ended.

Not what I anm referring to. But it is fine. I think it Is due to my Internet connection that my time and his appeared to be jumping