get object Document
We received a message from the MLS that you need us to contact you regarding an issue they are seeing related to high levels of queries.
0
1 Answer
- Sort by
oldest newest most voted
0
This is a dynamic batch query derived from all listings in our local database that do not have any history records in batches of 50 by class. I believe we picked a batch limit of 50 because some time ago there was issues with the large history resource queries larger than 50 per query.
Yesterday we did some testing and found that the server is working well with a history batch limit of 1,000 which is the same we do for Property resource.
Beginning with today's hourly jobs the history batch has been set to 1,000 per query. This will reduce the number of queries per minute during the very short run time of 2 to 4 minutes once an hour.
Please let me know if this resolves the issue.
Comments
Are you actually getting any history records in your pull?
NO!
After reviewing our logs, the last time anything was imported from the history resource was 8/30/17.
Why is that?
There seems to be an issue today with our RETS downloads at 10 AM all 3 batches failed, 11 am completed without errors, 12 pm all 3 batches failed, 1 pm all 3 batches completed without errors, the 2 pm 1st batch completed without error, the 2nd batch looks like it stalled, the 3rd batch has not run yet.
There were a couple of RETS refreshes done around those time periods. Those usually return "Server Temporarily Disabled" error which is what I see in our RETS logs.
Also, I don't see where you are calling "Logout" on your sessions. It would help keep our session information storage more tidy if you call "Logout" when your batch is finished.
OK, we will add Logout to all our queries
Thanks Tony. It is looking much better now.
Comments
Hello!
It looks like the traffic is about 371 queries per minute, which is quite a lot. Our question was in relation to the idea behind the current queries. Are you trying to build a 'base' set of data to work with, like a full download? Or is the idea behind these requests permanent?
Thank you,