This is completely correct. Nothing is wrong. There are no duplicates. This is how iphone handles photos.
ALL synced photos can be accessed from the Photo Library. Those exact same photos ( not duplicates) can be accessed via the folders as well.
Just as a book can be in the public library and in the fiction section, a photo can be in the photo library and in your folder. There is only one book and one photo.