[Python-modules-commits] r20098 - in packages/python-scrapelib/trunk (13 files)
achiang-guest at users.alioth.debian.org
achiang-guest at users.alioth.debian.org
Wed Jan 25 07:00:11 UTC 2012
Date: Wednesday, January 25, 2012 @ 07:00:08
Author: achiang-guest
Revision: 20098
[svn-inject] Applying Debian modifications (0.5.6-1) to trunk
Added:
packages/python-scrapelib/trunk/debian/
packages/python-scrapelib/trunk/debian/changelog
packages/python-scrapelib/trunk/debian/compat
packages/python-scrapelib/trunk/debian/control
packages/python-scrapelib/trunk/debian/copyright
packages/python-scrapelib/trunk/debian/python-scrapelib.install
packages/python-scrapelib/trunk/debian/rules
packages/python-scrapelib/trunk/debian/scrapeshell.1
packages/python-scrapelib/trunk/debian/scrapeshell.install
packages/python-scrapelib/trunk/debian/scrapeshell.manpages
packages/python-scrapelib/trunk/debian/source/
packages/python-scrapelib/trunk/debian/source/format
packages/python-scrapelib/trunk/debian/watch
Property changes on: packages/python-scrapelib/trunk/debian
___________________________________________________________________
Added: mergeWithUpstream
+ 1
Added: packages/python-scrapelib/trunk/debian/changelog
===================================================================
--- packages/python-scrapelib/trunk/debian/changelog (rev 0)
+++ packages/python-scrapelib/trunk/debian/changelog 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,5 @@
+python-scrapelib (0.5.6-1) unstable; urgency=low
+
+ * Initial release (Closes: #657278)
+
+ -- Alex Chiang <achiang at canonical.com> Wed, 25 Jan 2012 04:07:03 +0000
Added: packages/python-scrapelib/trunk/debian/compat
===================================================================
--- packages/python-scrapelib/trunk/debian/compat (rev 0)
+++ packages/python-scrapelib/trunk/debian/compat 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1 @@
+7
Added: packages/python-scrapelib/trunk/debian/control
===================================================================
--- packages/python-scrapelib/trunk/debian/control (rev 0)
+++ packages/python-scrapelib/trunk/debian/control 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,43 @@
+Source: python-scrapelib
+Maintainer: Alex Chiang <achiang at canonical.com>
+Section: python
+Priority: optional
+Build-Depends: debhelper (>= 7.0.50~),
+ python-all (>= 2.6.6-3),
+ python-flask,
+ python-httplib2,
+ python-mock,
+ python-setuptools,
+ python-unittest2
+Standards-Version: 3.9.2
+Homepage: https://github.com/sunlightlabs/scrapelib
+
+Package: python-scrapelib
+Architecture: all
+Depends: ${misc:Depends}, ${python:Depends}
+Breaks: ${python:Breaks}
+Recommends: python-httplib2
+Description: library for scraping websites
+ At its simplest provides a replacement for urllib2’s urlopen functionality
+ but can do much more.
+ .
+ Advantages of using scrapelib over urllib2 or httplib2 include:
+ .
+ * HTTP, HTTPS, FTP requests via an identical API
+ * HTTP caching, compression and cookies
+ * redirect following
+ * request throttling
+ * robots.txt compliance (optional)
+ * robust error handling
+
+Package: scrapeshell
+Section: net
+Architecture: all
+Depends: ipython,
+ python-scrapelib (= ${binary:Version}),
+ ${misc:Depends},
+ ${python:Depends}
+Recommends: python-lxml
+Description: ipython shell to examine python-scrapelib results
+ Start an interactive shell to inspect exactly what HTML is being returned
+ by python-scrapelib, as it may differ from what is presented to a browser.
Added: packages/python-scrapelib/trunk/debian/copyright
===================================================================
--- packages/python-scrapelib/trunk/debian/copyright (rev 0)
+++ packages/python-scrapelib/trunk/debian/copyright 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,56 @@
+Format: http://dep.debian.net/deps/dep5/
+Upstream-Name: scrapelib
+Upstream-Contact: Michael Stephens <mstephens at sunlightfoundation.com>
+ James Turk <jturk at sunlightfoundation.com>
+Source: https://github.com/sunlightlabs/scrapelib
+
+Files: *
+Copyright: Sunlight Labs (c) 2011
+License: BSD-3-clause
+ Redistribution and use in source and binary forms, with or without
+ modification, are permitted provided that the following conditions are met:
+ .
+ * Redistributions of source code must retain the above copyright notice,
+ this list of conditions and the following disclaimer.
+ * Redistributions in binary form must reproduce the above copyright notice,
+ this list of conditions and the following disclaimer in the documentation
+ and/or other materials provided with the distribution.
+ * Neither the name of Sunlight Labs nor the names of its contributors may
+ be used to endorse or promote products derived from this software without
+ specific prior written permission.
+ .
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+ "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+ LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+ A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
+ CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
+ EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
+ PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
+ PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
+ LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+ NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+ SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+Files: debian/*
+Copyright: 2012, Alex Chiang <achiang at canonical.com>
+License: BSD-2-clause
+ Redistribution and use in source and binary forms, with or without
+ modification, are permitted provided that the following conditions are met:
+ .
+ * Redistributions of source code must retain the above copyright notice,
+ this list of conditions and the following disclaimer.
+ * Redistributions in binary form must reproduce the above copyright notice,
+ this list of conditions and the following disclaimer in the documentation
+ and/or other materials provided with the distribution.
+ .
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+ "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+ LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+ A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
+ CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
+ EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
+ PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
+ PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
+ LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+ NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+ SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
Added: packages/python-scrapelib/trunk/debian/python-scrapelib.install
===================================================================
--- packages/python-scrapelib/trunk/debian/python-scrapelib.install (rev 0)
+++ packages/python-scrapelib/trunk/debian/python-scrapelib.install 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1 @@
+usr/lib/python2.*/*-packages
Added: packages/python-scrapelib/trunk/debian/rules
===================================================================
--- packages/python-scrapelib/trunk/debian/rules (rev 0)
+++ packages/python-scrapelib/trunk/debian/rules 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,17 @@
+#!/usr/bin/make -f
+
+%:
+ dh $@ --with python2 --buildsystem=python_distutils
+
+override_dh_auto_clean:
+ -find . -name '*.py[co]' | xargs rm -f
+ rm -rf *.egg-info
+ dh_clean
+
+override_dh_auto_test:
+ifeq ($(filter nocheck,$(DEB_BUILD_OPTIONS)),)
+ set -ex; for python in $(shell pyversions -r) ; do \
+ $$python $(CURDIR)/test.py; \
+ done
+endif
+
Property changes on: packages/python-scrapelib/trunk/debian/rules
___________________________________________________________________
Added: svn:executable
+ *
Added: packages/python-scrapelib/trunk/debian/scrapeshell.1
===================================================================
--- packages/python-scrapelib/trunk/debian/scrapeshell.1 (rev 0)
+++ packages/python-scrapelib/trunk/debian/scrapeshell.1 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,56 @@
+.\" This manpage is copyright (C) 2012 Alex Chiang <achiang at canonical.com>
+.\"
+.\" Redistribution and use in source and binary forms, with or without
+.\" modification, are permitted provided that the following conditions are met:
+.\"
+.\" * Redistributions of source code must retain the above copyright notice,
+.\" this list of conditions and the following disclaimer.
+.\" * Redistributions in binary form must reproduce the above copyright notice,
+.\" this list of conditions and the following disclaimer in the documentation
+.\" and/or other materials provided with the distribution.
+.\"
+.\" THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+.\" "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+.\" LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+.\" A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
+.\" CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
+.\" EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
+.\" PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
+.\" PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
+.\" LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+.\" NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+.\" SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+.TH SCRAPESHELL 1 "Jan. 24, 2012"
+.SH NAME
+scrapeshell \- ipython shell to examine python-scrapelib results
+.SH SYNOPSIS
+.B scrapeshell \fIurl\fR [\fIOPTION\fR]
+.SH DESCRIPTION
+Many times, especially during development, it is useful to open an interactive
+shell to tinker with a page. Often the HTML being returned is slightly out of
+sync with what is being seen in the browser, and it can be difficult to detect
+these differences without firing up an interactive python shell and inspecting
+what \fBurlopen()\fR is returning.
+
+scrapeshell opens an IPython shell. It will present the user with an instance
+of \fBResultStr\fR with the contents of the scraped page and if the
+\fBpython-lxml\fR module is installed, an \fBlxml.html.HtmlElement\fR instance
+as well.
+.SH OPTIONS
+.TP
+\fBurl\fR
+scrapeshell requires a URL, which will then be retrieved via a \fBurlopen()\fR
+call.
+.TP
+\fB\-\-ua\fR \fIuser_agent\fR
+Set a custom user agent (useful for seeing if a site is returning different
+results based on UA).
+.TP
+\fB\-\-robots\fR
+Obey robots.txt (default is to ignore).
+.TP
+\fB\-\-noredirect\fR
+Don’t follow redirects.
+.SH AUTHOR
+This manual page was written by Alex Chiang <achiang at canonical.com> for the
+Debian project (but may be used by others).
Added: packages/python-scrapelib/trunk/debian/scrapeshell.install
===================================================================
--- packages/python-scrapelib/trunk/debian/scrapeshell.install (rev 0)
+++ packages/python-scrapelib/trunk/debian/scrapeshell.install 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1 @@
+usr/bin/
Added: packages/python-scrapelib/trunk/debian/scrapeshell.manpages
===================================================================
--- packages/python-scrapelib/trunk/debian/scrapeshell.manpages (rev 0)
+++ packages/python-scrapelib/trunk/debian/scrapeshell.manpages 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1 @@
+debian/scrapeshell.1
Added: packages/python-scrapelib/trunk/debian/source/format
===================================================================
--- packages/python-scrapelib/trunk/debian/source/format (rev 0)
+++ packages/python-scrapelib/trunk/debian/source/format 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1 @@
+3.0 (quilt)
Added: packages/python-scrapelib/trunk/debian/watch
===================================================================
--- packages/python-scrapelib/trunk/debian/watch (rev 0)
+++ packages/python-scrapelib/trunk/debian/watch 2012-01-25 07:00:08 UTC (rev 20098)
@@ -0,0 +1,3 @@
+version=3
+opts=dversionmangle=s/\+debian.*$// \
+http://githubredir.debian.net/github/sunlightlabs/scrapelib/(.*).tar.gz
More information about the Python-modules-commits
mailing list