I am trying to find the changed values on website. For that I have written a iterator which will hit the website and get the html output. I have saved that html
I need to get the sensitivity (7th column) of each setting (row) site: https://prosettings.net/cs-go-pro-settings-gear-list/ table id: "table_1" 2 rows class: "
I access Websites in a loop via selenium Java based. Some of the sites crash imediately so that i get the error [1618982990.911][WARNING]: Timed out connecting
I want to get the text within a var tag which lies within a pseudo class: ::before ... <var class="added">Element</var> .. ::after I tried How locat
I have used scholarly package and parsed the author names generated in the 3 question its method search by author name to get the author profiles including all
I have working code that requests information from a website. When I send the file to another PC and run the code, I get: "Run-time error'91': Object variable
I'm attempting to scrape a website and these two rules seem to be contradictory in robots.txt User-agent: * Disallow: * Allow: / Does Allow: / mean that I can
A few days ago I started the development of a bot to capture data/results from virtual sports (specifically football) at Bet365 (note: I know this is not allowe
I am attempting to put together a real estate dataset, however when I try and extract the text from the website, for example the names of the places, it returns
I have a scraper that scrapes the video urls of all the posts of a user. I have implemented auto-scroll so that all the videos are loaded for me to scrape. I te
I need to create records in an airtable base and have the following code in scrapy: url = "https://api.airtable.com/v0/appuhKmlhLIIEszLm/Table%201" payload = j
Below is my code for scraping news about domestic violence. This code worked perfectly the first time I used it. But back then I covered only 2-3 months period,
Unfortunately I don't know how to source this and was wondering if someone could show me how. I am trying to learn hear so the correct answer is great, but the
I'm working on a tool to find all emails address from a domain name, as snov.io/hunter.io does. Do you have any idea about how to find all email address from th
I am trying to write a program that will give me the stock price for a few different stocks, but when I run my program, it returns 116.71, while Yahoo Finance h
I recently started coding a program with python selenium. The goal of the project is to calculate arbitrage possibilitys between two sport bookies (but that doe
https://www.transfermarkt.de/alexander-bade/profil/spieler/31 Is it possible to scrape the whole table in one scrape?
Website Link https://redacted xml options I have tried so far <span aria-labelledby="amount">722</span> //*[@id="amount"]/h3/span[2] /html/body/di
I want to scrape the value, but its selector is duplicate, I don't know how to solve. It will always scrape the value of the one above. here my code: const pupp
(In nodeJs -> server side only). I'm doing some webscraping and some pages are protected by the cloudflare anti-ddos page. I'm trying to bypasse this page. B