CARMLS Rets Feed Hangs
Every night we pull the statuses of all listings for each MLS we serve to clean up missed data. When I try to pull all the Residential listings for CARMLS, it hangs right about 100,000 listings (after about 1 minute). We haven't had this issue in the past. Is there possibly a problem with the underlying database?
We are accessing URL: https://carmls-rets.paragonrels.com/r... User: 11065
My last failed attempt was about 11:04 CDT Thanks, Paul Stallings
Comments
Thank you for the details, Paul. We'll begin reviewing.
Can you try this again and see if it works now?
Well, a tiny improvement. I'm pulling in 5,000 record chunks. It was failing when running a query with a 95,000 offset. This time it hung with the 100,000 offset. It's supposed to return 112,000 some odd records. But it's still hanging.
Are you using RETS Connector?
If so, on the General Tab, set the HTTP Timeout value to a larger value and see if it works then.
No, libRets. We pull much larger result sets than this with no problem. I don't even get an error. It just stops. It was waiting for more than 5 hours last night.
I have duplicated the issue issue and we are working on a fix. Property
RS_1
(L_AskingPrice=150001+)
L_ListingID,L_UpdateDate,L_Status,L_PictureCount,L_Last_Photo_updt,L_ListingDate
Offset: 100001
Limit: 5000
Please test this again today to see if you are still having issues with this?
Sorry Bruce, I replied to the e-mail I got this morning and didn't notice it was going to "no-reply". Looks like things are fixed. That job that has been getting hung wasn't this morning so I was hopefull. I just ran the AllListings search and saw that it is no longer hanging. I did notice that we had split this search into multiple smaller searches some time in the past (L_AskingPrice=150001+ and L_AskingPrice=150000-) presumably to get past a similar issue in the past. I'm guess that due to raising house prices, our 150001+ search was now returning more than 100.000 record ceiling we were seeing. Can you tell me what you changed? Hopefully it means I can remove these hacks we put in in the past since I forgot to look for them this time.
I would just monitor it this week and see how it does.