Yes, You can simply download a newer version and update accordingly. Ensure that the Connect server has sufficient permissions to download updates.
Check the permissions here: https://video2.skills-academy.com/en-us/entra/identity/hybrid/connect/reference-connect-accounts-permissions
You can also check events viewer logs to ensure no error is logged that is preventing the upgrade. See Applications and Services Logs > Microsoft > Entra ID Connect
If the above information was useful, please remember to Mark "Accept Answer" and 'Upvote'
Regards,
Abiola