Grammar doubt, Native English speakers, help needed, please?

Your sentence (3) is the right one. "Finally, last but not least" is fine, and you're right that "guilt" doesn't work in this context. The three options you present in sentence (3) are all good.