Patch files for Super Mario 64 ROM hacks usually come in one two forms: BPS or PPF.
BPS is an efficient, generic binary patch format. It supports delta-encoding, folder patching, infinite file sizes and checksum verification.
PPF (PlayStation Patch Format) is generic binary patch format. While inferior to BPS, it's the most common patch format used for older SM64 hacks.