/    Sign up×
Community /Pin to ProfileBookmark

Scraping php website

Hello, does anybody knows way how to scrap some site where i have from menu 5000 tabs, and every tabs have houndreds datas. Now i need that site in offline mode. How to do that ?

to post a comment
PHP

5 Comments(s)

Copy linkTweet thisAlerts:
@ginerjmDec 29.2017 — You want to try and explain that a little better?

'scrap'?

'houndreds'?


'from menu 5000 tabs'?


'datas'?

'in offline mode'?

Yes - I am picky. It makes it easier to figure out what one is trying to relate.

PS - a website once up and running is almost not recognizable as a "php website". How does one know it was written in php unless the url shows it as such? And why do you care for the purposes of your problem?
Copy linkTweet thisAlerts:
@rootDec 29.2017 — He wants a site scraper tool.

In short, instead of just helping yourself to the site, why not ask the site owner if you can use their data with credits and attribution to them...
Copy linkTweet thisAlerts:
@ginerjmDec 29.2017 — I barely gleaned that from the original post, but thought I would drive home the need for posters to re-read their post or at least try to use their language skills in as good a way as possible.

But - knowing that the task involved scraping I still couldn't understand what all the other references were about. And so far there seems to be no more info forthcoming...
Copy linkTweet thisAlerts:
@rootDec 31.2017 — [SIZE=3]Amigo, lo siento, no entiendo porque no hablo español.[/SIZE]
Copy linkTweet thisAlerts:
@phpmillionDec 31.2017 — It depends on your needs. If you just want to scrap whole site at once, use any basic tool as HTTrack ( http://www.httrack.com/ ).

If you need very specific parts of site (just some text data, no images, etc.), and want them to be re-downloaded at specific periods every X hours/days/weeks, you may need to write your own scrapper (PHP + curl should be enough), which extracts just the text you want.

Or, as . wisely suggest, contact site's owner asking if he can provide you with data or some kind of API.
×

Success!

Help @delijai spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 BETA 5.8,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...