I'm new to BeautifulSoup and web scraping so please bare with me. I'm using Beautiful soup to pull all job post cards from LinkedIn with the title "Security Eng
When using __del__ datetime.date.today() throws ImportError: sys.meta_path is None, Python is likely shutting down import datetime import time import sys clas
The following part of my code is supposed to do exception handling during HTTP requests. app.py class Get: def __init__(self, url): self.url = url
Is there any way to limit how many items I want to get from a JSON request? the code I use: import json import requests url = 'https://api.github.com/users' re
I had a script that would login to my UPS.com account to receive all incoming packages. The following code was working for a while but not anymore: import reque
I don't know how to solve this problem i'm trying a long time now but i'm stuck. I've tried different Libarys for GraphQL requests but nothing is working so tha
I'm working on a personal project and I'm trying to retrieve air quality data from the https://aqicn.org website using their API. I've used this code, which I'v
I am trying to scrape https://registry.verra.org/app/search/VCS/All%20Projects for a school project. I am trying to send a request to the "download excel" butto
You see, there is this website called edabit. All you need to know is that I want to scrape the website without using selenium. I want to learn how. What does s
i'm trying to crawl website with python requests GET and having problem with Object.setPrototypeOf i added userAgent in header but it still gives me under code
I am trying to use requests.get with the Spotify API and I can't figure out why I keep getting a 400 response. I am working in an .ipynb file in Jupyter Lab run
I'm using the Requests library with Python 2.7 and get the following error: Traceback (most recent call last): File "/home/user/Documents/workspaces/controlle
I'm on macOS Monterey 12.3 running Python 3.9.7 installed via brew. Given this minimal replication of my production code: import requests try: response = r
I am using FastAPI to serve some ML models and I have a Streamlit basic UI using Python Requests module. One of my service is getting an image through a POST re
I hope for your help. Because I have been struggling with this problem for a long time. A POST request comes from the frontend with one PDF file, after which I
I have the following endpoint in my FastAPI server: @app.post("/submit") async def submit(file1: List[UploadFile] = File(...), file2: List[UploadFile] = File(..
I'm unable to connect to the URL using requests module, but it works fine when browsed in a browser. Could it be some robots.txt issue Allowed/Disallowed issue
I am trying to collect Captcha images using the Python requests module and save them to file or load in memory for further processing, but nothing works as belo
I need to create records in an airtable base and have the following code in scrapy: url = "https://api.airtable.com/v0/appuhKmlhLIIEszLm/Table%201" payload = j
I can unzip a url zip file of csvs using the below code: import requests from zipfile import ZipFile from io import BytesIO import pandas as pd z = 'www.someur