/    Sign up×
Community /Pin to ProfileBookmark

Checking scraped page, then goto URL if variable in cell is right?

Copy linkTweet thisAlerts:
Jan 29.2017

Im using a web scraping script that I didn’t code. Works good but I want to locate a number in a particular cell, see if its higher than 200, if it is goto url that the number is linked up with.

I figure I can add some javascript code in order to do this.
I think I need an elementId on the TD. But after that I dont know what to do. Can someone point me in a good direction?

Here’s the html below.

[CODE]<td style=”text-align:center”><a target=”_blank” href=”[COLOR=”#0000CD”]https://www.ctcfgh.com[/COLOR]”>[B]500[/B]</a></td>[/CODE]

to post a comment
JavaScript

10 Comments(s) ↴

Copy linkTweet thisAlerts:
@rootJan 29.2017 — How are you obtaining the data? In other words, what rights to the data do you have?
Copy linkTweet thisAlerts:
@jedaisoulJan 29.2017 — Hi and welcome to the site. Altering code that you have not written is always difficult. All I can suggest is that you always keep a copy of the code before you altered it, an make one change at a time. That way you can step-back if it goes horribly wrong.
Copy linkTweet thisAlerts:
@shawnbks9090authorJan 29.2017 — How are you obtaining the data? In other words, what rights to the data do you have?[/QUOTE]

they allow the site to be scraped.
Copy linkTweet thisAlerts:
@rootJan 29.2017 — They who?

If they allow the site to be scraped then why are they not offering something like a data dump or RSS type feed to process?
Copy linkTweet thisAlerts:
@shawnbks9090authorJan 29.2017 — . What are you getting at? Am I the only person scraping webpages? Your'e annoying. Im just trying to get some help and now I got the hall monitor hassling me.
Copy linkTweet thisAlerts:
@TrainJan 29.2017 — Acceptable Use Policy

http://www.webdeveloper.com/aup.html

copyright applies world wide.
<i>
</i>the exclusive legal right, given to an originator or an assignee to print, publish, perform, film, or record literary, artistic, or musical material, and to authorize others to do the same.
Copy linkTweet thisAlerts:
@shawnbks9090authorJan 29.2017 — Who is printing or recording anything? Are we talking about the script Im using or the data Im retrieving? Ive got permission to use the script. The data Im getting is allowed to be gotten. Is web scraping illegal? Whats the fuss about here?
Copy linkTweet thisAlerts:
@rootJan 29.2017 — I was trying to ascertain if you have permission, no most people don't just scrape data and re-use it, they obtain permission to do so or it is given through a creative commons agreement.

You have not said where the data is coming from and I said what I said about data dumps and RSS feed because thats the usual way in which data is shared.

Republishing rights don't always rely on money, allot of the time it relies on the originator of that data to have some credit given to being the originator.

From your comment, it is clear that you are not concerned with a little thing called copyright, just because others may do it does not mean that they can or do get away with it.

Intellectual property is copyright material and you should email the site owner and ask permission, all it takes is a simple email requesting that you say what purpose your need for this data is for. Scraping without permission is stealing and stealing is illegal.
Copy linkTweet thisAlerts:
@shawnbks9090authorJan 30.2017 — bunch of ****ing pussies.
Copy linkTweet thisAlerts:
@rootJan 30.2017 — bunch of ****ing pussies.[/QUOTE]

Uncalled for given the line of enquiry, you want help, you need to provide information and its not just about what you need, its about the AUP of this site, which you will find many sites will operate a user policy and this sites AUP prohibits helping copyright fraud.
×

Success!

Help @shawnbks9090 spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 — BETA 5.28,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...