Photos available before listing - photos get skipped

retag add tags

I think I've discovered an issue where we miss photos when the photos are added before the listing. This affects markets where we use GetObject on the Property resource to download photos. I'm wondering if there's a recommended download strategy for these. Here's an example issue for IMLS listing 98738877:

L_FirstPhotoAddDt = 2019-07-26T20:05:52.4

L_Last_Photo_updt = 2019-07-26T20:05:52.4

Our system shows the listing was first downloaded 2019-07-27T17:29:47Z, which is after the photos were added. Assuming our system downloaded the listing shortly after the listing was added, this would imply the photo date was set to a time before the record was actually available. This would cause our photo download process to skip over this record because it wasn't available yet.

Our photo download process queries a date range using the L_Last_Photo_updt field. It sets the next "min" date based on the "max" value of the current results.

Does this make sense? If so, how should I change our photo download process so that we don't have this problem?

This isn't specific to IMLS, it affects several markets we consume...this is just an example.

Thanks much!

MattMessmer

asked 2019-07-29 13:15:31 -0500

edit flag offensive 0 remove flag close merge delete

Comments

add a comment see more comments

I wish there was more of a hard and fast, clear cut logic for this but there isn't.
There are many variables that apply to each RETS feed which can affect if and when a listing is made available.
Not to mention that the data and images can change at any given time, even while you are pulling them.
The listing you mentioned for example, was actually entered: 2019-07-26 20:05:51.0Z
The images were added: 2019-07-26 20:05:52.4Z
But the listing may not have been available to your feed until: 2019-07-27 17:26:35.7Z.
The only way I know to somewhat mitigate these types of issues would be to track the last photo update date and pull the images whenever it changes.
If it is a new listing you didn't have before, you know you need to pull the images.
When data is updated, check the photo update date you have stored locally against the new data's photo date and pull images whenever it changes.

Comments

That's helpful to know that I shouldn't assume the listing is available in our feed immediately after the timestamp shows it's entered. I've played around with a solution like the one you suggested...I'll keep working on that. Thanks much!

MattMessmer (2019-07-29 14:47:24 -0500) edit

Photos available before listing - photos get skipped

Comments

1 Answer

Comments

Your Answer

Photos available before listing - photos get skipped edit

Comments

1 Answer

Comments

Your Answer

Photos available before listing - photos get skipped