User Tools

Site Tools


programming:python:clcheck

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
programming:python:clcheck [2010/05/03 01:35] crustymonkeyprogramming:python:clcheck [2011/03/29 20:15] (current) – [What is it?] jay
Line 1: Line 1:
 ====== Craigslist Search and Notify Script ====== ====== Craigslist Search and Notify Script ======
 +===== NO LONGER MAINTAINED =====
 +Sorry to anyone who has arrived here, but I'm no longer maintaining this script.  I remembered, when initially writing it, what a pain in the ass it was to try and maintain a screen scraping app.  Scraping Craigslist, I've found, is especially masochistic since the site seems to sometimes vary slightly between cities on top of the fact that once they change the underlying HTML (which is pretty awful to start with), it breaks everything.
 +
 +It's not the most complicated of scripts, so anyone with some Python chops should be able to still take the base and do some tweaking (mainly of the regular expressions) and get this to work.  I just don't have the large amount of time to sink into supporting something that is broken by the whims of others.  If, in the future, Craigslist publishes a real API of some sort, I will be happy as a clam to rewrite this app using that.  Bottom line here: screen scraping sucks for anyone doing it. 
 +
 ===== What is it? ===== ===== What is it? =====
 A friend of mine asked me recently if I knew of a script that would perform a search on [[http://craigslist.org|craigslist.org]] and send him an email when there were new results to his search.  He's always looking for oddball stuff and by the time //he// finds it on craigslist and emails/calls the person, the item is already gone. A friend of mine asked me recently if I knew of a script that would perform a search on [[http://craigslist.org|craigslist.org]] and send him an email when there were new results to his search.  He's always looking for oddball stuff and by the time //he// finds it on craigslist and emails/calls the person, the item is already gone.
Line 7: Line 12:
 ===== The Script and Config File ===== ===== The Script and Config File =====
 Setting this up is a piece of cake.  All you have to do is get the script and the example config file, edit the config and run the script.  This has been tested to work under both Windows and Linux with Python 2.6, but it should work just fine under pretty much any platform.  If you run into some kind of error, run the script in debugging mode and send the output to <admin@splitstreams.com> so I can fix it. Setting this up is a piece of cake.  All you have to do is get the script and the example config file, edit the config and run the script.  This has been tested to work under both Windows and Linux with Python 2.6, but it should work just fine under pretty much any platform.  If you run into some kind of error, run the script in debugging mode and send the output to <admin@splitstreams.com> so I can fix it.
- 
 ==== Getting the Files ==== ==== Getting the Files ====
 === Subversion === === Subversion ===
Line 18: Line 22:
 If you don't have [[http://subversion.tigris.org/|Subversion]] installed, you can just browse the to the url above, right click on each file and select "Save Link As" and save a copy of the script and config example file.  On the [[http://subversion.tigris.org/|Subversion]] note, if you are on Windows, I highly suggest using [[http://tortoisesvn.tigris.org/|TortoiseSVN]] for actual SVN access. If you don't have [[http://subversion.tigris.org/|Subversion]] installed, you can just browse the to the url above, right click on each file and select "Save Link As" and save a copy of the script and config example file.  On the [[http://subversion.tigris.org/|Subversion]] note, if you are on Windows, I highly suggest using [[http://tortoisesvn.tigris.org/|TortoiseSVN]] for actual SVN access.
 === Download the Package === === Download the Package ===
-The package can be downloaded directly by {{:programming:python:clwatch-0.3.4.tar.gz|clicking here}}.+The package can be downloaded directly by {{:programming:python:clwatch-0.3.5.tar.gz|clicking here}}.
  
 ==== The Example Config ==== ==== The Example Config ====
Line 328: Line 332:
  
 If you run into any bugs, you can either email me or open a bug report at https://bugzilla.splitstreams.com If you run into any bugs, you can either email me or open a bug report at https://bugzilla.splitstreams.com
- 
programming/python/clcheck.txt · Last modified: 2011/03/29 20:15 by jay