Several markets timing out

edit

Yep, queries are still hanging. I most commonly see open house queries timing out. At that point in our code, we should already be logged in. Shouldn't be an ISP issue because we're able to download updates from other non-Paragon markets.

Digging into this more, I'm unable to reproduce the issue locally, so maybe it is on my end. Still investigating and will post again when I'm done.

This is weird. I can't repro locally but it's still only happening with Paragon feeds, most of them get stuck on open house downloads. Is there any rate limiting in place? Wondering why it would only affect the production servers.

Don't know. When you run locally are you using the same ISP?

Nope, our production servers are hosted in Microsoft Azure.

I just saw a timeout on login for NEREN, if that helps. Seems intermittent though.

Looking at MAXEBRDI in our logs. In the last 24 hours I've only seen 2 transactions over 30 seconds.
One was a little over 30 seconds the other is a little over 60 and they were both property.

My apologies, looking further, I think these are login failures. It's hard to tell in libRETS.

I've confirmed these are login failures. I was able to alleviate the symptoms by setting a separate timeout for logins, only 30 seconds. This helps our servers not get stuck on these at least, but this is still an issue.

So all of the ones you listed above are having intermittent login errors?

Yep, and more markets beyond that, too. But yeah it is intermittent, I just saw a failure for a calrets.mlslistings at 4:04pm PDT, but it just tried again at 4:18 and it worked. Thanks for looking into this, I know intermittent issues are painful to troubleshoot.

Are you using the same IP or group of IP addresses for all of them?
Wondering if it might be an issue with a particular IP address or something.
I'll have to look more tomorrow.

Yeah, all the production servers are behind the same load balancer (same IP). Locally I'm using a different IP. No worries, it can wait. The timeout change I made mitigated most of the symptoms, we're not nearly as far behind now. Thanks again!

This is still happening for several markets but it's still intermittent. Simply retrying seems to fix the issue. As a result, it's not really a problem for us, but just wanted to let you know because I also didn't want to needlessly spam login requests :)

Thanks for letting us know.
Make sure you put some kind of delay before retries.
Also limit the number of retries so it doesn't get stuck in retry loops hammering the servers.

Can you verify that the URLs you are using are formatted correctly.
Especially the ones you use after login.
"mlsid-rets.paragonrels.com/rets/fnisrets.aspx/MLSID//rets/fnisrets.aspx/MLSID/login?rets-version=RETS/1.7.2"
"mlsid-rets.paragonrels.com/rets/fnisrets.aspx/MLSID/rets/fnisrets.aspx/MLSID/login?rets-version=RETS/1.7.2"