The world keeps moving, software products too. An application’s objectives, structures, requirements, and assumptions that have been elicited and analyzed previously may need to be reassessed and updated. In order to fully understand these requirements evolutions, what changes are necessary, and why those changes are needed, one essential source of requirements is user feedback. However, handling and analyzing so many user feedbacks can be time-consuming. Using natural language processing tools for Bahasa Indonesia and Naïve Bayes classifier, this research aims to develop a tool to process natural language and classify user feedbacks. The developed tool is expected to make feedback classification less time-consuming so that developers can project their energy to more productive and creative works. The machine learning models are built using the feedback dataset taken from an up-and-running university e-learning system and show promising results.