Why can't I delete the sites folder and settings.php file in my Drupal install?

This is actually a security feature built into Drupal. Upon configuration/installation it sets restrictive permissions on the sites folder and settings.php. You may reset the perms by running fixwebperms.sh or manually changing the permissions on those files.