“Makes” is a verb, so it requires an adverb to describe frequency. “Rarely” is the adverb corresponding to the adjective “rare.” The natural sentence is usually written “He rarely makes a mistake,” although the intended grammatical choice here is clearly “rarely.”