If I recall, only the Razor Sword isn't permanent. But who even used the Razor Sword anyway? It goes back to the Kokiri Sword after it hits something 100 times. In any case, it would be a waste for the Gilded Sword to be lost if you want back in time, especially after all the hard work you went through to get it.