Having issues pulling data from GACAR MLS

  • retag add tags

I have been having issues since our client's renewal lapsed. They got it renewed and now the data is not pulling. It continues to give us errors. We have verified with the local board that everything is set properly - RETS is turned on, agent and office records are Active and the security levels are correct. I also verified the login credentials.

I also checked restmd.com and am able to login there as well.

Here's the raw request and response I'm getting

php test.php Username: Forrester8769 Password: Login URL: https://gacarmls-rets.paragonrels.com... [2020-07-06 22:23:28] PHRETS.DEBUG: Loading Monolog\Logger logger [] [] [2020-07-06 22:23:28] PHRETS.DEBUG: Sending HTTP Request for https://gacarmls-rets.paragonrels.com... (Login) {"auth":["Forrester8769","*","digest"],"headers":{"User-Agent":"RETSMD/1.0","RETS-Version":"RETS/1.7.2","Accept-Encoding":"gzip","Accept":"/*"},"curl":{"10031":"/private/tmp/phretsl59hzb"}} [] [2020-07-06 22:23:29] PHRETS.DEBUG: ClientException: 401: Client error: GET https://gacarmls-rets.paragonrels.com/rets/fnisrets.aspx/gacarmls/login?rets-version=rets/1.7.2 resulted in a 401 Unauthorized response [] [] PHP Fatal error: Uncaught GuzzleHttp\Exception\ClientException: Client error: GET https://gacarmls-rets.paragonrels.com/rets/fnisrets.aspx/gacarmls/login?rets-version=rets/1.7.2 resulted in a 401 Unauthorized response in /Users/thinkery/Code/PHRETS/vendor/guzzlehttp/guzzle/src/Exception/RequestException.php:113

In speaking with local MLS support they asked this morning if we had tried again and yes we continue to try but nothing. There are properties still showing that have been sold and properties with prices that have changed that are not updating. I even tried changing the last pull date setting back to 4-01-20 to get all the info that has changed since then but still no updates / changes.

The local response is that they read that with PHRETS sometimes the initial login will give that response: The 401 response following the initial GET is natural and required in digest authentication. This gives the server the first opportunity to send back it's digest values which the client needs to calculate the password to pass back in the 2nd GET. The next response should either be a 401 or 200 response.

The Cron job ran again this morning at 6:00 am. And still it's not pulling the data.

Please help.

bludove30's avatar
bludove30
asked 2020-07-08 09:12:19 -0500
bwolven's avatar
bwolven
updated 2020-07-21 10:30:10 -0500
edit flag offensive 0 remove flag close merge delete

Comments

HTTPS URL needs basic authentication and it looks like you are using Digest.
Try switching to basic or change URL to HTTP.

bwolven's avatar bwolven (2020-07-08 09:41:32 -0500) edit

Did you get this working?

bwolven's avatar bwolven (2020-07-08 14:36:10 -0500) edit

No ... not yet. I just saw your last comment and just saw the comment before where you told me what to do. I will let you know

bludove30's avatar bludove30 (2020-07-09 16:20:44 -0500) edit

Ok. Hope it helps.

bwolven's avatar bwolven (2020-07-09 16:21:44 -0500) edit

It's still not updating on the live site. My dev was able to get it working on his local machine but I'm at a loss.

bludove30's avatar bludove30 (2020-07-10 14:09:12 -0500) edit

Are you sure you updated the URL, credentials, and authentication type on the live site to match the one that is working?

bwolven's avatar bwolven (2020-07-13 10:14:24 -0500) edit

yes I am sure I updated everything. I verified the login credentials are correct.

bludove30's avatar bludove30 (2020-07-15 01:13:29 -0500) edit

And you are sure you are using Basic for HTTPS or Digest with HTTP URL?

bwolven's avatar bwolven (2020-07-15 06:48:35 -0500) edit

Honestly I am not even sure. I am the one that maintains the overall website and I have an extension I'm using with the CMS. The developer of the extension is the one that would know. UNLESS there's a way for me to look at something and tell. Would it say somewhere in a configuration file or something?

bludove30's avatar bludove30 (2020-07-15 09:38:42 -0500) edit

From my developer - Every software relies on other packages, since no one reinvents the wheel every time they build something. My importer uses the phrets library to connect to the rets server and get your data. The breakdown here is between phrets and curl, which is another library used to make http requests. I sent you the link to the known issue about this from the phrets mailing list. I've also posted my problem on their list and opened an issue on github.They advise changing the version of curl. Your host says they can't / won't do that, and that's where we are.

bludove30's avatar bludove30 (2020-07-16 10:01:44 -0500) edit

@bwolven --- did you see my last comment?

bludove30's avatar bludove30 (2020-07-17 14:14:22 -0500) edit

Is there anyone that can help me .... please!!

bludove30's avatar bludove30 (2020-07-20 09:26:47 -0500) edit

What PHRETS version are you using?

bwolven's avatar bwolven (2020-07-21 09:48:29 -0500) edit

Where do I look to tell you that information?

bludove30's avatar bludove30 (2020-07-21 10:03:05 -0500) edit

When I look at our logs I see login requests using User-Agent="IPROPERTY/1.0"
From IP address=166.62.39.200
The logins look like they are successful with no other transactions being sent.
Last one was: 2020-07-21 08:59:01.903 CST.
No corresponding logout request.

bwolven's avatar bwolven (2020-07-21 10:40:31 -0500) edit

Can you try using HTTP in the URL instead of HTTPS and see if it works?

http://gacarmls-rets.paragonrels.com/rets/fnisrets.aspx/GACARMLS/login?rets-version=rets/1.7.2
bwolven's avatar bwolven (2020-07-21 13:29:25 -0500) edit

We tried using http instead of https and that didn't make a difference. Is there somewhere I can get some phone support. This has gone on for several weeks now and I just can't seem to get headway.

bludove30's avatar bludove30 (2020-07-21 23:27:14 -0500) edit

From what I can tell looking at our logs today it looks like you are working now?
I see search requests and image pulls happening.

bwolven's avatar bwolven (2020-07-22 08:57:43 -0500) edit

Bludove... Did you get this problem resolved? I have been having a similar problem dowloading properties with the iProperty extension and have received next to no help from iProperty/The Thinkery. If it is resolved what needed to be done?

JohnJWest's avatar JohnJWest (2020-08-06 09:19:37 -0500) edit
add a comment see more comments