Menu
Php Experts,
When I say “simple php” I mean php’s old functions or ‘page fetching’ functions that are not php cURL.
Q1.
Do you mind listing all the page fetching functions in php that you know along with their shortcomings ?
I only came across these 2 when checking out Web Crawler tutorial php codes.
file_get_content();
file_get_html();
That way, I can checkout each and everyone’s strengths and limitations.
Q2.
file_get_content();
file_get_html();
I read the 1st function sometimes fail to fetch pages. If that’s true then, why is that ?
And is the 2nd one any better ?
I read it is best to use the cURL instead. Can you confirm this ? Don’t forget to answer.
Anyway, most tutorials online that teach you how to build a web crawler are not on php cURL but simply php using those 2 functions or the ‘simple_html_dom.php’ .
Q3.
I was looking into php cURL before coming across the ”simple_html_dom.php’.
I realise with cURL you have to write way more code than simple php just to fetch webpages remotely from other servers. Can you confirm this is true ?
Q4.
Modern tutorials promote the ‘simple_html_dom.php’. Can you confirm Php cURL does not use it but only simple php uses it ? And if only simple php uses it then should I stick to simple php and the ‘simple_html_dom.php’ or should I revert back to php’s cURL ? Remember, I need to build a web crawler that is capable of fetching all external server pages. Can’t afford misfires like the file_get_content() function.