Hi,
Please check the alerts settings of the list. From your description it seems that the users who are getting alerts might has subscribed for the alerts (When an item is addded).
You can also check the same by going to Site settings and then user alerts and there you can select a user to find out the alerts he has subscribed it.
I hope this will help you out.
Thanks,
Rahul Rashu