Data was dumped into adls gen 2 using azure synapse connector by dataverse . Later we built the pipeline with upsert logic using dataflow to ingeat thw data into datawarehouse from adls.
The issue which i am facing seems intermittent, sometimw data is being uploaded without any issue in the debug mode using upsert logic written. Sometimes it is not as thw data preview at the source end dataflow itself ia showing the older data. I am suspecting it could be cache related issue.
Is there any resolution for this.
Or any idea will we face the same iasue at trigger mode as well.