Esmoof, correct me if I am wrong you are not using "Friends" plugin and users can chat with anybody on your site ?
Cron should have offlined those users if they were inactive for some time. Can you make sure that your Cron is up and running? ( do you receive activity notifications by email)? Do members stay "online" forever under "Members" section of your site?