Hi,
For SR issues, I would always start by review the Microsoft-Windows-StorageReplica event logs. This can help you determine if there are issues going on within your environment. In some cases, it may be necessary to break the relationship, fix the issue, then recreate the relationship. Note that if you do this, you can use the -SeededSync parameter when recreating the replica as most of the data between the disks should be close to the same. This will help to speed up the initial replication.
I would also consider what replication type you are using (Synchronous vs Asynchronous). Synchronous replication requires a high bandwidth, low latency (less than 5ms RTT) network connection. If the network between the sites is higher latency or becoming congested, this can cause these intermittent issues.
Finally, I would also ensure that you have properly configured the SR constraints on your nodes. This ensures that traffic is using the proper network interfaces.
More information can be found at the links below:
Hope this helps!