Durlabh, can you log in to your admin panel and make sure that
1. that under "Privacy and Permissions">>Global Privacy you have "Yes" checked for "Guests can view the site".
2. "Pages and Menus">>Pages and menus>> hover the mouse over each menu item>>click "edit". Make sure that all needed pages are "Visible For" guest users.