Thanks for reading my story. That’s a great question.
I can’t say how readers will react, only how I think they should react. I don’t think readers should be angry at that. You’re simply describing, good or bad. Describing something that happened doesn’t mean you approve of it. Someone used that word in your experience, so say so. There’s a difference between writing a word and using it. You’re describing other people using it, so you are not responsible. I wrote it in my story but that doesn’t mean I used it as an insult either.
If you want to, though, maybe you could write a disclaimer, perhaps in an introduction. Let us know when your memoir is done!