Nal won't necessarily make you inorgasmic, but it blocks the endorphin rush you'd normally feel. If you still enjoy the sex, great -- have fun.
I would tend to avoid that, personally, because I wouldn't want to inadvertently extinguish my sex drive or intermittent-reinforce it into a sex addiction. I like it as it is.

I wouldn't think one evening would do much harm, though, especially since it sounds like that was an unusual frolic.
To answer your direct question -- no, it does not mean that TSM won't work for you. It doesn't mean that you're immune to naltrexone because you managed to have some fun anyway. There are multiple ways to have fun, and sex touches on several of them.