First time here? Check out the FAQ!
0

Triangle MLS Photo Issue [closed]

We can only download about 4400 photos from Triangle MLS then we start getting 403 Forbidden errors. This has been happening throughout the weekend and we cannot finish our import. We have about 26000 photos to download to update, please advise how we can get these photos or if there is in issue with your image server.

Credentials: URL: https://triangle.apps.retsiq.com/rets... User: DDrelianceidx

chglfish's avatar
chglfish
asked 2022-08-01 10:27:24 -0500
bwolven's avatar
bwolven
updated 2022-08-02 12:00:42 -0500
edit flag offensive 0 remove flag reopen merge delete

Closed for the following reason the question is answered, right answer was accepted by chglfish
close date 2022-08-26 11:04:43.709105

Comments

Where are you getting the 403 error?
Is it when pulling the data or downloading images using the URLs?

bwolven's avatar bwolven (2022-08-01 10:39:20 -0500) edit

When downloading images.

chglfish's avatar chglfish (2022-08-01 10:45:52 -0500) edit
add a comment see more comments

1 Answer

0

When pulling images by URL from the CDN. There is a Rate limit of: 5000 requests within 5 minutes, per IP Address, across all "cdnpara*.paragonrels.com" image URLs. When the limit is exceeded, the IP address is then blocked for several hours and a 403 error is returned while it is blocked. Limits were implemented to address abuse and to ensure stability of systems for our customers. To avoid this, you can add delays between image requests and/or you can also use multiple IP addresses, especially if you access multiple MLSs.

bwolven's avatar
bwolven
answered 2022-08-01 10:48:31 -0500
edit flag offensive 0 remove flag delete link

Comments

Were you able to slow your rate and get this working?

bwolven's avatar bwolven (2022-08-02 08:21:25 -0500) edit

We added a delay in case it is needed between photo set requests. TY

chglfish's avatar chglfish (2022-08-26 11:04:37 -0500) edit
add a comment see more comments