First time here? Check out the FAQ!

CARMLS Rets Feed Hangs

Every night we pull the statuses of all listings for each MLS we serve to clean up missed data. When I try to pull all the Residential listings for CARMLS, it hangs right about 100,000 listings (after about 1 minute). We haven't had this issue in the past. Is there possibly a problem with the underlying database?

We are accessing URL: User: 11065

My last failed attempt was about 11:04 CDT Thanks, Paul Stallings

pstallings's avatar
asked 2023-05-05 11:15:28 -0500
edit flag offensive 0 remove flag close merge delete


Thank you for the details, Paul. We'll begin reviewing.

Joe_Brueske's avatar Joe_Brueske (2023-05-05 11:17:08 -0500) edit

Can you try this again and see if it works now?

bwolven's avatar bwolven (2023-05-05 13:32:52 -0500) edit

Well, a tiny improvement. I'm pulling in 5,000 record chunks. It was failing when running a query with a 95,000 offset. This time it hung with the 100,000 offset. It's supposed to return 112,000 some odd records. But it's still hanging.

pstallings's avatar pstallings (2023-05-05 13:42:57 -0500) edit

Are you using RETS Connector?
If so, on the General Tab, set the HTTP Timeout value to a larger value and see if it works then.

bwolven's avatar bwolven (2023-05-05 13:47:48 -0500) edit

No, libRets. We pull much larger result sets than this with no problem. I don't even get an error. It just stops. It was waiting for more than 5 hours last night.

pstallings's avatar pstallings (2023-05-05 13:51:01 -0500) edit

I have duplicated the issue issue and we are working on a fix. Property
Offset: 100001
Limit: 5000

bwolven's avatar bwolven (2023-05-05 17:11:35 -0500) edit

Please test this again today to see if you are still having issues with this?

bwolven's avatar bwolven (2023-05-08 13:59:25 -0500) edit

Sorry Bruce, I replied to the e-mail I got this morning and didn't notice it was going to "no-reply". Looks like things are fixed. That job that has been getting hung wasn't this morning so I was hopefull. I just ran the AllListings search and saw that it is no longer hanging. I did notice that we had split this search into multiple smaller searches some time in the past (L_AskingPrice=150001+ and L_AskingPrice=150000-) presumably to get past a similar issue in the past. I'm guess that due to raising house prices, our 150001+ search was now returning more than 100.000 record ceiling we were seeing. Can you tell me what you changed? Hopefully it means I can remove these hacks we put in in the past since I forgot to look for them this time.

pstallings's avatar pstallings (2023-05-08 14:04:20 -0500) edit

I would just monitor it this week and see how it does.

bwolven's avatar bwolven (2023-05-08 14:10:31 -0500) edit
add a comment see more comments

1 Answer


Hi Paul,

We've released a fix. Please verify your original query is working.

Joe_Brueske's avatar
answered 2023-05-11 12:12:36 -0500
edit flag offensive 0 remove flag delete link


@pstallings You can also try removing your workarounds and see if it works reliably and quicker without it.

bwolven's avatar bwolven (2023-05-11 12:30:59 -0500) edit

Worked fine. Actually, it's been working fine all week. I think it no longer has a short pause at 100K. Will this change effect our other Paragon RETS feeds? I think we had similar tricks to break queries into smaller than 100K chunks elsewhere. I'll try simplifying our queries when I get a breather. Thanks!

pstallings's avatar pstallings (2023-05-11 12:57:15 -0500) edit

Thank you. We had put a temporary fix in place, but released a permanent fix, so we wanted to make sure it worked.

Joe_Brueske's avatar Joe_Brueske (2023-05-11 13:40:04 -0500) edit

Will this change effect our other Paragon RETS feeds?

pstallings's avatar pstallings (2023-05-11 13:42:14 -0500) edit

It was a stability fix. If you weren't having this issue with them, then I wouldn't worry about it. If you did find an issue in another system, this fix will be deployed early next week.

Joe_Brueske's avatar Joe_Brueske (2023-05-11 13:43:21 -0500) edit

@pstallings The fix has been deployed to the remaining Paragon RETS servers so you can try removing your workarounds a little at a time and see if it performs better with the fix.

bwolven's avatar bwolven (2023-05-15 12:10:33 -0500) edit
add a comment see more comments

Your Answer

Login/Signup to Answer