How to delete an app from the App Library

When I delete an app from my Home Screen, it only removes it from the home screen but it stays in the App Library. Then my App Library, does not give me the option to delete the app, only to put it back in the Home Screen.