Menu
Community /Pin to ProfileBookmark
@NogDogJun 27.2016 — #Assuming I'm correctly understanding what you want to do, RSS will probably only help you if the sites you want to pull from already provide an RSS feed. If they do, then you'll need code to grab their feed, which will output XML, and parse that XML to get whatever it is that you want to use from it. In order to avoid hitting each such RSS feed whenever a user of your site makes a request, I'd be inclined to do the RSS interactions on the server side on your site, rather than via JavaScript in the browser, allowing you to cache feed results for some reasonable amount of time on your site (e.g. in a DB, or other data storage means). @NogDogJun 28.2016 — #I'll start with the last question, since it's the easiest (from my perspective of what I do for a living ? ). It's actually the inverse: the server-side code will ultimately output the client-side code (HTML and JavaScript). Therefore, if you build your app in PHP, the PHP code will at some point be outputting HTML, which might include loading of CSS and JS files, as well as in-line JS -- whatever you need to eventually get sent to the browser.
As far as wanting to collect assorted comics from the web and put them in one easy-to-read location: I'll leave that to the intellectual property lawyers. (I'm definitely not a lawyer -- I don't even play one on TV.) My assumption would be that if a copyright owner is supplying a RSS feed, what is in that feed is intended for consumption and eventual display elsewhere -- otherwise there's no reason to supply such a feed. But if you take that info, and, for instance, use it to "scrape" additional content directly from their site so that you can display it on yours, you now are possibly stepping into copyright infringement territory, etc. (Again, I'm not a lawyer -- I just want you to think about it, and contact your own legal consul if you want to cover your butt.)
As for what's in an RSS feed, I believe it is typical to output some limited amount of recent content, but conceivably such a feed could be created to supply it by date range, etc. -- but I'm not sure if that's part of the RSS standard.@NogDogJun 29.2016 — #Scraping is seldom "simple", unless the site in question want you to access some/all of their content -- in which case they might provide an API to do so. Of course, even if they do, it's unlikely any two API's would be the same, so you'd have to have site-specific code for each one (which would also be true if you want to scrape the site directly by crawling the site, parsing the HTML, and extracting what you're interested in, as no two sites are likely to have the same HTML structure).
As far as the PHP or other server-side stuff, you'd still be writing HTML/CSS/JavaScript as needed, but it would ultimately be output from that server-side application code, which could happen in a number of ways. For instance, in PHP, you could explicitly echo out the page's HTML, or you can actually just have whatever you want outside of the <?php...?> tags, which is automatically output as is.
Web comic aggregator RSS feed general questions?
Hello,I am trying to create a web comic aggregation website using HTML 5, CSS 3, and JavaScript. I would like users to be able to view comics of different dates from different websites all in one place. After some research, it seems like I’m probably going to need to use an RSS feed to accomplish this. However, I don’t fully understand the capabilities and usage of an RSS feed.
First, would it be possible to pull images from comic websites in an automated and orderly fashion using an RSS feed? Or would I need to use something else? Or would it not be possible at all? If it is possible with an RSS feed, I’m also confused somewhat about the general implementation. Would the code for the feed be in HTML, or JavaScript, or both? Would I need to use existing libraries and or APIs? Is their existing code with a similar enough function that I could use it as a starting point?
Thanks
Sign in
to post a comment7 Comments(s) ↴
0
@NogDogJun 27.2016 — #0
@NogDogJun 28.2016 — #I'll start with the last question, since it's the easiest (from my perspective of what I do for a living ? ). It's actually the inverse: the server-side code will ultimately output the client-side code (HTML and JavaScript). Therefore, if you build your app in PHP, the PHP code will at some point be outputting HTML, which might include loading of CSS and JS files, as well as in-line JS -- whatever you need to eventually get sent to the browser.As far as wanting to collect assorted comics from the web and put them in one easy-to-read location: I'll leave that to the intellectual property lawyers. (I'm definitely not a lawyer -- I don't even play one on TV.) My assumption would be that if a copyright owner is supplying a RSS feed, what is in that feed is intended for consumption and eventual display elsewhere -- otherwise there's no reason to supply such a feed. But if you take that info, and, for instance, use it to "scrape" additional content directly from their site so that you can display it on yours, you now are possibly stepping into copyright infringement territory, etc. (Again, I'm not a lawyer -- I just want you to think about it, and contact your own legal consul if you want to cover your butt.)
As for what's in an RSS feed, I believe it is typical to output some limited amount of recent content, but conceivably such a feed could be created to supply it by date range, etc. -- but I'm not sure if that's part of the RSS standard.
0
@NogDogJun 29.2016 — #Scraping is seldom "simple", unless the site in question want you to access some/all of their content -- in which case they might provide an API to do so. Of course, even if they do, it's unlikely any two API's would be the same, so you'd have to have site-specific code for each one (which would also be true if you want to scrape the site directly by crawling the site, parsing the HTML, and extracting what you're interested in, as no two sites are likely to have the same HTML structure).As far as the PHP or other server-side stuff, you'd still be writing HTML/CSS/JavaScript as needed, but it would ultimately be output from that server-side application code, which could happen in a number of ways. For instance, in PHP, you could explicitly echo out the page's HTML, or you can actually just have whatever you want outside of the <?php...?> tags, which is automatically output as is.
[code=php]
<html>
<head><title>This is output as is</title></head>
<body>
<?php
echo "<h1>A PHP Echo Statement</h1>";
?>
</body>
</html>
[/code]