A drop in your subscriber count is most likely because of a spam block. A spam block is temporary and those e-mail addresses will be added back into your database in 48 hours.
Please look here for more information.
Also, be sure to run an 'E-mail Delivery Report'. This will allow you to see how many messages were delivered successfully, and how many bounces you had.
Look here for information regarding reports.