Menu
I have a site were I use cURL to bring the contents of a client’s site into another aspect of the site. One of the things I am doing is custom searches.
There are state (and country) links that then bring up category links. When the category is selected, the sub-cats show up. Then when you click the sub-cat, it shows your search results. One line in the search results displays the number of results. I don’t have direct access to the database on this part of the site, so my only choice is to scrape it.
What I want to do is make a script that once a day will go through each state (and country) and strip out that number and store it. When the categories are displayed, it will show how many matches are in all the subcats combined for that category and state (or country). When the subcats are displayed, the number of matches for that sub-cat are displayed.
My first thought was a flat file system, but I have not worked with them a whole lot, and I think it could get hairy. There are dozens of categories, and some have dozens of subcats.
I could set up a MySQL database, but again, not sure the best route.
Any suggestions? I am not asking for code, but rather an outline of how you might handle it.
Thanks,
TecBrat.