Who fact checks the fact checkers?

The public. They share all their sources and logic behind their conclusions after all, so everyone who reads fact checking reports can judge for themselves if it's accurate.