Residents are furious after a developer cleared land and removed protected slow worms from a site near Fareham Community Hospital.