Can I remove administrators from a pinboard?

Yes, admins can also be removed from pinboards.

However, you cannot remove the admin who created the pinboard - he or she is 'responsible' for the pinboard, so to speak.

As an admin, you are not automatically a member of every pinboard, but you have an overview of all pinboards in the organisation via the Admin Cockpit.