Solution:
We opened a ticket with Microsoft.
Microsoft employee suggested to make another view which was showing in new experience as default view. I had tried this before but this time he suggested to click on Save View option. Then he told me to visit the All Documents view and we saw it in new experience and then again he recommended to click on Save view option. After this the All Documents view started showing in new experience.