I recently started using weka, and I'm trying to classify tweets as positive or negative using Naive Bayes. So, I have a training set with tweets for which I gave a shortcut, and a test set with tweets that have a “positive” shortcut. When I ran Naive Bayes, I get the following results:
Correctly classified specimens: 69 92% Incorrectly classified specimens: 6 8%
Then, if I changed the tweet labels in the test set to “negative” and ran to Naive Bayes again, the results will be inverted:
Correctly classified specimens: 6 8% Incorrectly classified specimens: 69 92%
I thought that properly classified instances show Naive Bayes accuracy and that it should be the same regardless of the tweet labels in the test set. Is there something wrong with my data or am I misunderstanding the meaning of correctly classified instances?
Thanks so much for your time,
Nantia
nadia source
share