I was noticing this for a little while, and finally narrowed it down to Firefox, and found the following support post to fix the issue.

https://support.mozilla.org/en-US/questions/1049291

After following the instruction to uncheck the "Use hardware acceleration when available", and restarting Firefox, the videos no longer had the flicker when playing.