web scraping - Cannot scrap basic information via Scrapy Python from a school website -
i want scrap basic information our school alumni website(need log in using student account). test if script works, tried scrap person's name. if succeeded, have moved on.
i sure code correct because tested other ones. however, scraping our school's, didn't work. because precedent process logging account? or else? if need results cmd line, add soon.
any advice or recommendations helpful. thank you.
# -*- coding: utf-8 -*- import scrapy class namespider(scrapy.spider): name = 'name' start_urls = ['https://rutgers.peoplegrove.com/hub/student-alumni-career-connect/people'] def parse(self, response): yield{ 'names':response.css('div.content::text').extract_first() }
Comments
Post a Comment