Looks like the usual spelling is indeed “criminy”, and “crimony” is listed as an alternate spelling in Wiktionary. TIL what the expression derives from:

A minced oath from “Christ’s money”, in reference to the silver that Judas was paid for betraying Jesus.