Ask Your Question
0

Feed download stopping for no reason

asked 2020-10-20 01:38:49 -0600

Hello,

I've been trying to replicate the rets database with a startdate of 01/01/2019 Somehow, the feed stops without any specific reason. I have 154994 listings in my database mapping RE_1.

Could you check your logs why I am not able to retrieve more data. I have no errors in my logs. The username is 206539671

Thanks Eric

edit retag flag offensive close merge delete

Comments

Are you just doing your initial data pull then will do incremental pulls after that?

bwolven gravatar imagebwolven ( 2020-10-20 05:29:19 -0600 )edit

It could be that it is a timeout issue.
In my PHRETS tests I have these set:
ini_set('memory_limit','16384M');
ini_set("default_socket_timeout", 6000); // seconds

bwolven gravatar imagebwolven ( 2020-10-20 10:57:13 -0600 )edit

I've found the following error in my log file. I restarted the replication and it crashed on the following

[Tue Oct 20 20:09:11.372106 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): Entity: line 5004: parser error : internal error: Huge input lookup in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php on line 14 [Tue Oct 20 20:09:11.372145 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): 1458\tR01741458\t\t\t\t\t\t\t\tSue\tKumari\t01241597\t206515712\t\t206515712\t\tRED OA

eculus gravatar imageeculus ( 2020-10-20 15:26:35 -0600 )edit

There are some strange results in the XML coming from rets. It seems to be crashing on that.

eculus gravatar imageeculus ( 2020-10-20 15:27:08 -0600 )edit

[Tue Oct 20 20:09:11.372145 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): 1458\tR01741458\t\t\t\t\t\t\t\tSue\tKumari\t01241597\t206515712\t\t206515712\t\tRED OAK REALTY\tO in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php on line 14 [Tue Oct 20 20:09:11.372151 2020] [php7:warn] [pid 8168] [client 127.0.0.1:44886] PHP Warning: SimpleXMLElement::__construct(): \t \t\t\t\t\t\t\t\t \t \t \t \t\t \t\t \t^ in /var/app/current/vendor/troydavisson/phrets/src/Parsers/XML.php

eculus gravatar imageeculus ( 2020-10-20 15:27:41 -0600 )edit

I saw this one that talks about the "Huge Input Lookup" error above:
https://stackoverflow.com/questions/4...

bwolven gravatar imagebwolven ( 2020-10-21 15:59:45 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2020-10-23 01:33:13 -0600

I solved it, I reduced the number of listings limit from 5000 to 3000 in my request and the download was done overnight.

edit flag offensive delete link more

Comments

Glad to hear you got it working.
I figured it had to be some kind of data size or memory limitation from the error you listed.
With my test scripts, I had to bump the "memory_limit" setting up because I was getting errors.
But I'm far from being a PHP or PHRETS expert.

bwolven gravatar imagebwolven ( 2020-10-23 08:48:47 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2020-10-20 01:38:49 -0600

Seen: 33 times

Last updated: Oct 23