Omaha - the RETS photo task fails frequently, sometimes several times in a day

asked 2021-08-04 08:43:08 -0500

updated 2021-08-06 07:57:45 -0500

Sample of most recent:

Task name: 'gprmls_photos'
Start time: 7/31/2021 3:11:00 PM
Server time: Sat, 31 Jul 2021 15:11:00 GMT
Time spent: 00:01:09.7527189
Status: FAILED
Copy of logfile in "C:\Users\Administrator\Documents\mls_pipeline\logs\gprmls\gprmls_photo.log":
Running task "gprmls_photos"
User name: 971266
Incremental pull since 7/31/2021 10:29:52 AM
Local time: 7/31/2021 3:11:00 PM
Server time: Sat, 31 Jul 2021 15:11:00 GMT
Last modification time found: 7/31/2021 3:11:00 PM

Running step "photos"
Search query: (L_UpdateDate=2021-07-31T10:29:52+),(L_StatusCatID=|1),(L_AskingPrice=100000-300000)
RETS Status code = 0: Operation Successful

Downloading media: Photo
Failed to retrieve media: The request was aborted: The request was canceled.
RETS status code = -1:
No Photo found
    Step finished at 7/31/2021 3:12:09 PM

C:\fakepath\gprmls - rets photo task 1.png

C:\fakepath\gprmls - rets photo task 2.png

C:\fakepath\gprmls - rets photo task 3.png

C:\fakepath\gprmls - rets photo task 4.png

C:\fakepath\gprmls - rets photo task 5.png

edit retag flag offensive close merge delete


Not sure without more detailed error information.
You could try increasing the connections timeout value.
It could be taking too long and timing out or something like that.

bwolven gravatar imagebwolven ( 2021-08-04 14:15:24 -0500 )edit

Ok, I will look to see if I can figure out the timeout setting. Regarding more error info, this is what is emailed by RETS on failure. Where can I see more detail on the error?

Rodica T gravatar imageRodica T ( 2021-08-04 20:09:29 -0500 )edit

If you are using RETS Connector, the timeout value is on the tasks General tab.
There is also a Log file tab that you can set logging.

bwolven gravatar imagebwolven ( 2021-08-05 10:13:15 -0500 )edit

Hi @bwolven, I updated the questions with snapshots of the RETS task. The timeout is 60 seconds - that is what we use for most of our tasks.

Also, snapshot of a log from a failed run (similar with what is posted in the main question): image description

Rodica T gravatar imageRodica T ( 2021-08-06 07:59:09 -0500 )edit

I would change the timeout from 60 to 240 and see if that helps.
You are requesting all photos for several listings at a time which could take a while to return.

bwolven gravatar imagebwolven ( 2021-08-06 09:41:11 -0500 )edit

Were you able to get this working better?

bwolven gravatar imagebwolven ( 2021-08-11 13:54:35 -0500 )edit

Sorry, was on PTO during second half of August and just now seeing this. I have just now increased the timeout and will monitor. I will say it is an unusually high interval for timeout - all other RETS jobs work with smaller values...

Rodica T gravatar imageRodica T ( 2021-09-09 11:11:08 -0500 )edit

The best way to pull images is to either use the Media resource and download using the URL returned.
Or use GETOBJECT with Location=1 to get the URL and download the image using the URL returned.

bwolven gravatar imagebwolven ( 2021-09-09 14:44:04 -0500 )edit

Would you happen to know of a documentation link on how to implement either of the approaches?

Rodica T gravatar imageRodica T ( 2021-09-09 16:32:52 -0500 )edit