Yes, you should be able to assign Azure RBAC roles to guests (without creating them an ID in your tenant):
Assign Azure roles to external guest users using the Azure portal
Add a guest user to your directory
Assign a role to a guest user
If this is helpful please accept answer.