[Python-apps-team] Bug#813313: [planet-venus] fails on SNI enabled websites

Antoine Beaupré anarcat at orangeseeds.org
Fri May 13 20:42:58 UTC 2016


> The faulty code in planet venus itself is in planet/spider.py, around
> line 300, in the httpThread function. It *looks* like it could be fairly
> easy to convert it to requests, as the API usage is fairly superficial.

Well, "easy"... There's only a few calls to httplib itself, but it makes
heavy use of the API it turns out. It uses the resp object extensively,
and even uses the cache. So it will need to be cleaned up and use
cachecontrol:

https://github.com/ionrock/cachecontrol

... which is not in stable...

Hopefully, httplib2 will just fix this?

a.
-- 
Marijuana grows naturally on the planet.
Mushrooms grows naturally on the planet.
Don't you think making nature against the law is a bit... unnatural?
                        - Bill Hicks



More information about the Python-apps-team mailing list