Hello @Shweta Chandramouli ,
Unfortunately, you cannot specific a Status Folder for HDInsight Spark Job trigged through Data Factory.
Reason: Azure Data Factory creates [auto-generated-GUID] once HDInsight Spark job completes.
I would suggest you to provide feedback on the same:
https://feedback.azure.com/forums/270578-data-factory
All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.
Hope this helps. Do let us know if you any further queries.
------------
Please don’t forget to Accept Answer
and Up-Vote
wherever the information provided helps you, this can be beneficial to other community members.