@Koteswara Pentakota , Thanks for posting this good question.
As I understand that you have followed the steps outlined in this doc to configure Enterprise-grade edge (Preview).
You don't need to add static images manually. If you enable this feature, everything from your website has enhanced performance.
It's just that the same place where you deploy the website, you can add static images also. Those images get stored in the nearby storage accounts for caching and improved performance.
If you still have additional questions on this or if I have misunderstood your question, please let us know with additional details on what you’re attempting to accomplish.
-- Accelerate your websites with Azure Static Web Apps enterprise-edge