Hi,
I assume "Explorer on Taskbar" means the icon in the middle of Edge and Windows Store icons (default).
It is actually a shortcut inside C:\Users\<account>\AppData\Roaming\Microsoft\Internet Explorer\Quick Launch\User Pinned\TaskBar.
please check if it is applicable as well.
Please remember to mark the replies as answers if they help and un-mark them if they provide no help. If you have feedback for TechNet Support, contact tnmff@microsoft.com.