It's more the things that happened rather than the holiday itself. One of the first celebrations involved settlers in America and the Native American's that had lived there. The Native American's helped the settlers to make it through a hard winter and it was a celebration of thanks. But eventually things went very badly between settlers and the Native American. For some Native American's it just brings back bad memories, especially those that were alive then.