First time here? Check out the FAQ!
0

Feed download stopping for no reason

Hello,

I've been trying to replicate the rets database with a startdate of 01/01/2019 Somehow, the feed stops without any specific reason. I have 154994 listings in my database mapping RE_1.

Could you check your logs why I am not able to retrieve more data. I have no errors in my logs. The username is 206539671

Thanks Eric

eculus's avatar
eculus
asked 2020-10-20 01:38:49 -0500
edit flag offensive 0 remove flag close merge delete

Comments

Are you just doing your initial data pull then will do incremental pulls after that?

bwolven's avatar bwolven (2020-10-20 05:29:19 -0500) edit

It could be that it is a timeout issue.
In my PHRETS tests I have these set:
ini_set('memory_limit','16384M');
ini_set("default_socket_timeout", 6000); // seconds

bwolven's avatar bwolven (2020-10-20 10:57:13 -0500) edit

I've found the following error in my log file. I restarted the replication and it crashed on the following

[Tue Oct 20 20:09:11.372106 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): Entity: line 5004: parser error : internal error: Huge input lookup in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php on line 14 [Tue Oct 20 20:09:11.372145 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): 1458\tR01741458\t\t\t\t\t\t\t\tSue\tKumari\t01241597\t206515712\t\t206515712\t\tRED OA

eculus's avatar eculus (2020-10-20 15:26:35 -0500) edit

There are some strange results in the XML coming from rets. It seems to be crashing on that.

eculus's avatar eculus (2020-10-20 15:27:08 -0500) edit

[Tue Oct 20 20:09:11.372145 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): 1458\tR01741458\t\t\t\t\t\t\t\tSue\tKumari\t01241597\t206515712\t\t206515712\t\tRED OAK REALTY\tO in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php on line 14 [Tue Oct 20 20:09:11.372151 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): \t \t\t\t\t\t\t\t\t \t \t \t \t\t \t\t \t^ in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php

eculus's avatar eculus (2020-10-20 15:27:41 -0500) edit

I saw this one that talks about the "Huge Input Lookup" error above:
https://stackoverflow.com/questions/4...

bwolven's avatar bwolven (2020-10-21 15:59:45 -0500) edit
add a comment see more comments

1 Answer

0

I solved it, I reduced the number of listings limit from 5000 to 3000 in my request and the download was done overnight.

eculus's avatar
eculus
answered 2020-10-23 01:33:13 -0500
edit flag offensive 0 remove flag delete link

Comments

Glad to hear you got it working.
I figured it had to be some kind of data size or memory limitation from the error you listed.
With my test scripts, I had to bump the "memory_limit" setting up because I was getting errors.
But I'm far from being a PHP or PHRETS expert.

bwolven's avatar bwolven (2020-10-23 08:48:47 -0500) edit
add a comment see more comments

Your Answer

Login/Signup to Answer