Reproducer: 1. Create a project 2. Run `mvn compile shamrock:dev` 3. Create a servlet 4. Check it's served 5. Delete the servlet 6. Servlet is still served, while it should not.