Hi,
As the article said: "OneNote doesn't automatically organize or alphabetize section or page tabs. You can keep your notebooks organized by arranging your section tabs and page tabs in a way that is meaningful to you."
You need to sort it manually, you can try to give a feedback to Microsoft about your requirement:
Microsoft values your opinion. Your feedback goes directly to our engineers and helps us shape the future of Microsoft products and services for all our users.
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.