I am a beginner in web scraping with Beautiful Soup and I am trying to get the teams with their wins and losses in Euroleague from https://www.basketball-reference.com/international/euroleague/2020.html 我想遍历该表并获取名称的得失，以后再将它们插入CSV列表或JSON文件中。 通过下面的代码，即使我尝试了...

我有10个公司链接。 https://www.zaubacorp.com/company/ASHRAFI-MEDIA-NETWORK-PRIVATE-LIMITED/U22120GJ2019PTC111757, https://www.zaubacorp.com/company/METTLE-PUBLICATIONS-PRIVATE-LIMITED/U22120MH2019PTC329729, https://www.zaubacorp.com/company/PRINTSCAPE-INDIA-PRIVAT...

Closed. This question needs debugging details. It is not currently accepting answers. ...

I'm trying to create a function that will extract search results from this webpage but am getting stuck because I want the function to automate the search for multiple foundations and I'm not sure how to revise the function so that it either loops over all...

Closed. This question needs to be more focused. It is not currently accepting answers. ...

我想在产品信息的对象数组内创建产品尺寸的对象数组。 这是我要刮的HTML树 <div class="product-thumbShim"></div><a target="_blank" href="tshirts/herenow/herenow-men-black-printed-round-neck-t-shirt/4318138/buy" style="display: block;"><div class="product-imageSliderContainer"><div class="prod...

Trying to scrape homepage of website https://genshin.gg public class Scraper { private readonly HttpClient _client = new HttpClient(); public async Task<string> GetPage(string url) { return await _client.GetStringAsync(url); } ...

来自asp.net页面的页面源如下所示： <table class="tbl dentry1" style="margin-top:2vh;"> <tr> <td>Conv - A&nbsp;</td> <td><input name="ctl00$ContentPlaceHolder1$tha" type="text" value="6" id="ctl00_ContentPlaceH...

我正在调试一个简短的脚本，以从一系列论文中获取引文计数和摘要。在调试时，我遇到了一个Captcha块。但是，我最多只每4-5分钟执行一次脚本。这是一个重现我的问题的最小工作示例： from scrapy.crawler import CrawlerProcess import re class ResArt_Spider(scrapy.Spider): name = "restart_spider" def start_requests(self): url_start ...

我目前正在使用网络抓取工具，以抓取评估人的本地州房屋数据。事情进展得很顺利，但是不幸的是，数据非常嵌套，因此我必须做很多工作才能真正获得所需网页的正确链接。 数据的结构如下： 有81个城镇，因此每个城镇都有一系列链接。 每条街道的开头大约有20-30个字母/符号（因为街道是由本网站上的首个字母分页的），所以我需要获取每个城镇的街道链接（将我们放在大约2500页上） 每个字母大约有20条街道，我需要刮擦这些页面才能在每条街道上获得房屋（45,000页） 每条街道平均有16座房屋，我需要这些URL（75000...

那是我的代码工作正常。 import pandas as pd html_data = """<table id="example" class="table table-hover dataTable no-footer" role="grid" aria-describedby="example_info"> <thead> <tr role="row"><th class="sorting_...

我正在抓取Amazon产品图像，但有时会得到base64字符串而不是图像链接，因此我想将此字符串转换为image。 我尝试了此代码，但出现错误 码： import base64 from PIL import Image from io import BytesIO f = open('C:\\Users\\pc\\Desktop\\base64.txt','r') data = f.read() im = Image.open(BytesIO(base64.b64decode(data))) im.sa...

I am new to stacker flow and this is my first post, so I hope I can explain myself well and you can help me! Thanks in advance for your help!! I am using Scrapy to web scrap a popular real statement website from my native country. I am doing well with all ...

I got the following code which is scraping the following web page here. from selenium import webdriver import os from selenium.webdriver.common.by import By from selenium.webdriver.support.ui import WebDriverWait from selenium.webdriver.support import ...

我有以下文字： text = """<table class="table table-striped">\n <thead>\n <tr>\n <th data-field="placement">Placement</th>\n <th data-fi...

I am trying to extract using Puppeteer the title of this page: https://www.nordstrom.com/s/zella-high-waist-studio-pocket-7-8-leggings/5460106 我有以下代码， (async () => { const browser = await puppet.launch({ headless: true }); ...

我正在尝试创建代码以从网站上刮掉“指环王”脚本并将其粘贴到Excel电子表格中。我从创建代码开始为一页执行此操作，一切都很好，但是，当我添加一个循环遍历包含脚本的所有页面时，遇到了一个问题，每次电子表格的内容都会被覆盖刮了一个新页面。 Looking at the documentation for openpyxl, I understand that I should be using .append(), and I tried to do that, inside the if loop after...

所以我一直在尝试在python中使用scrapy来抓取imdb.com，这是代码： class FilmDataBasicSpider(scrapy.Spider): name = 'imdb_crawling_machine_3000' allowed_domains = ['www.imdb.com'] def start_requests(self): genres = ['action' ,'adventure' , 'animation' , 'biography' , 'comedy...

I am trying to make a program which automatically gets information from this site and to begin with I've started small to only collect all the countries using the classes of the elements. However, it seems to be very inconsistent and keeps giving results ...

我有以下代码： def get_songs_link(link_of_artist): r = requests.get(link_of_artist).text sleep(randint(4,8)) obj = BeautifulSoup(r, 'html.parser') album={} for item in obj.select("#listAlbum > .album"): name = item.text songs =...