I am using BeautifulSoup and Selenium to extract web data (beautifulsoup to parse the HTML page and Selenium to click Next to get to the next list of items on t
I'm trying to scrape the data that only appears on mouseover(selenium). It's a concert map and this is my entire code. I keep getting TypeError: 'ActionChains'
I want to scrape this website https://lens.zhihu.com/api/v4/videos/1123764263738900480 to get the play_url using Python. This website has a very quick redirect
I had a script that would login to my UPS.com account to receive all incoming packages. The following code was working for a while but not anymore: import reque
I am trying to scrape some product ID and UPC of products in Target using Selenium in Python. I cannot find product id and UPC in product page so i go to the pa
My html is below: <html> <body> <div> ... </div> <script id="1" ...> </script> </body> </ht
I'm currently trying to scrape some data from Twitter, like username, screen name, the content of the tweet etc. But I've run into some problems: I've been tryi
I just started my first Web scraping project and out of some reason when I try to run this simple code, it prints all of the headlines twice. I have no Idea why
I'm trying to scrape google for related searches when given a list of keywords, and then output these related searches into a csv file. My problem is getting be
I'm following a Udemy course on learning BS4 and it seems to be a bit outdated so I'm having trouble with this part. The objective is to scrape the price of thi
I'm using Python3 with BeautifulSoup. I want to scrape data for a few employees from a site, depending on their ID number. My code: for UID in range(201810000,2
I think I have tried it all, read crummy, read documentation on Beautifulsoup4 website. I can't get this thing wrapped around my head. So to the question: &
I need to scrape "2015" and "09/09/2015" from the below link: lacentrale.fr/auto-occasion-annonce-87102353714.html But since there are many li and ul, I cant sc
So I am webs scraping the sofifa website into a workable csv. Each player gets a column. My main problem is the position section of the website is only exportin
I am trying to fetch a URL from a webpage, here is how the URL looks in the Inspect section: Here is how the URL looks in my python-code: How can I get the ac
I am trying to write a program that will give me the stock price for a few different stocks, but when I run my program, it returns 116.71, while Yahoo Finance h
I have a simple python program, that is supposed to scrape some information from the internet and do stuff with it. When I run the code in PyCharm (IDE) it work
I'm getting UnicodeEncodeError: 'charmap' codec can't encode character '\u200b' in position 756: character maps to error while running this code:: from bs4 imp
I am trying to scrape the first 20 links on a Wikipedia page but I want to ignore the infobox on the right side. It has a 'table' tag. Here is what I have so fa
My problem Hi everyone I am attempting to develop my very first web scraper using the Google API and Beautiful Soup in Python. The aim is for the scraper to