Questions tagged as 'scrapy'

Tagged questions
1
answer

RaTengo doubt when scraping this site

I have little knowledge with scrapy, although I have been able to scrape several pages, I am trying to scrape some retail in my country, to make things easier for the population when comparing the prices of the products. and here is my problems....
asked by 08.11.2018 / 04:39
0
answers

Database and SpiderCrawl

I have a database in Stata (I know it's complicated to use Stata and Python, but there's no problem as I can export the database to Excel) Now, this database has Name, Surname, Date of birth as variables, and I want to use the data from this...
asked by 26.10.2018 / 19:53
1
answer

I need to take data from a page with scrapy and export it to mysql

Good morning. I need to take data from the table on the link page and I must do it with scrapy, looking for information on the internet, I found that It would not be the best scrapy option, but since I was asked from work I have no choice....
asked by 25.10.2018 / 20:30
0
answers

I have problems with scrapy in anaconda 3

I'm trying to use scrapy in anaconda 3 over windows 10, more specifically in spider. Scrapy as such, it is installed and when I have to import it or create the classes of the examples that I see on the internet, it works perfectly. Now when I t...
asked by 23.10.2018 / 05:26
0
answers

Send web form in java

My code is as follows: WebClient client = new WebClient(); client.getOptions().setCssEnabled(false); client.getOptions().setJavaScriptEnabled(true); client.getOptions().setThrowExceptionOnScriptError(false); HtmlPage page = cl...
asked by 19.09.2018 / 10:01
0
answers

Spider error processing url

I am making my first spider, I need to enter a specific category, enter the publications and obtain the required data, but I found the following error that I can not solve. items.py import scrapy class ReporteinmobiliarioItem(scrapy.Ite...
asked by 11.09.2018 / 15:48
1
answer

Python HTTPConnectionPool Failed to establish a new connection: [Errno 11004] getaddrinfo failed

I was trying to follow a scraping tutorial on grupoothis , and I The following error arises after a couple of queries. The error in question Traceback (most recent call last): File "C:\Users\Sebastián\AppData\Local\Programs\Python...
asked by 17.06.2018 / 22:30
1
answer

I have problems with urllib2 in Python 2.71

I have this request: import urllib2 f = urllib2.urlopen('http://www.python.org/') print f.read(100) but when I run it in Python 2.7.1, I get the following error:    AttributeError: 'module' object has not attribute 'urlopen'     
asked by 06.03.2017 / 23:41
1
answer

Scrapy can not find my spider

I have problems with Scrapy, for some reason when I run the project does not find my spider, but as much as I look at the code I can not find why. I had already used a similar code in another version of the code and found the spider. I leave...
asked by 29.10.2018 / 18:46