thanks, i have try to use bootcamp to cancel the partition and do it all over again, and it finally can auto delete the osxreserved partition.
there are three main differences between this time and the failed on before, in case someone also come across this problem, for your reference.
1. i have plug in the empty usb stick in first time, but i remove it in the second try.
2. i have install the update before restart the computer after installing the bootcamp driver in first time, but i immediately reboot the computer after installing the bootcamp driver in second trial.
3. i install win 8.1 and upgrade to win 10 the first time, and i do a direct install of win 10 the second time.
hope can helps. i do the change stated above is mainly because i thought that the main concept for the new bootcamp is that you don't need usb to install windows, and the partition created is for installing the windows, and it will be deleted after rebooting when you complete the install process.
therefore i try to prepare the whole process so that it strictly follow the concept from Apple, and avoiding anything that might interrupt the process.
but i guess Apple should still investigate into the matter and try to make the process smooth even users not installing in the ideal way that apple think users should done.