If you want to restrict department visibility to a particular set of users, you can do so by using permissions for that department. You can do so from: Admin CP -> Departments -> Manage Departments -> Select the Department -> Permission: Users tab -> Select the User Groups who should be able to view this Department -> Update.
Sandeep Kaur