Cannot delete an old calendar on iphone4

I share an icloud calendar with my two iphones, 4 and 4s and that works well. When I try to delete an older calendar from the 4 it disappears momentarily and then pops right back on. The 4 uses ios 7 and the 4s uses ios8. Any help will be appreciated. Fred