Category "puppeteer"

How to scrape an image src using puppeteer in NodeJS?

I'm trying to scrape the source of the first image with a specific class. On the page, there are multiple images with different additional classes but they shar

Puppeteer - Facing Issue to scroll in-page content on linkedin sales navigator

I am trying to scrape details of a few companies and their leads from the Linkedin Sales Navigator. The problem I am facing is that, the code only scrapes top 2

Puppeteer - Facing Issue to scroll in-page content on linkedin sales navigator

I am trying to scrape details of a few companies and their leads from the Linkedin Sales Navigator. The problem I am facing is that, the code only scrapes top 2

Google Maps data scraping using Puppeteer JS NODE JS error issue

I am trying to scrape data from Google Maps. I have written a Puppeteer JS code and run it with NODE JS. I am receiving this error. Recieved an error, attemptin

Cannot query clipboard when running puppeteer in headless mode

The code below works when puppeteer runs with { headless: false } but fails when it's true. The error is DataError: No valid data on clipboard.. Why is this hap

puppeteer page.evaluate() returns empty object

I am trying to scrape this web https://poe.ninja/challenge/builds?time-machine=day-6 using Puppeteer. I tried Puppeteer page.evaluate querySelectorAll return em

Puppeteer Scrolling And Clicking Selectiors with Same Class names

I'm quiet new to Puppeteer and NodeJs, so im trying to scrape a certain website where there are multiple posts that has this List element on clicking on it the

Puppeteer - How to use page.click() inside page.evaluate()

I am scraping a table and each row has a button to show a modal with information. I need to scraping the information from the modal for each row but I dont know

Why isn't Puppeteer page.click waiting (maybe Browserless?)

Goal: I have a page that I need to get html from after first clicking something on the page. Issue: The html that comes back is not waiting for that element cli

What is causing Error TypeError: text is not iterable? - Web scraper Puppeteer NodeJs

I am learning nodejs/puppeteer and having issues getting Puppeteer to fill UPC numbers from a CSV file onto the search bar of a book website. I managed to get a

Get Puppeteer Page/Frame Handle for new page after `ElementHandle.click()`

Using puppeteer, I have a specific page that I am web-scraping for data and screenshot-ing for proof that the data is correct. The web page itself includes a bu

Puppeeteer hangs when multiple instances of node are run

We have a node application which will launch a web application using puppeteer and take multiple screen shots to create a pdf file. This node application is lau

How can I get an element by xpath?

I need to find any element in DOM by xpath. I already tried the following: let el = await page.$x('//*[@id="readium-right-panel"]/ul/li[1]'); The returning e

Puppeteer not giving accurate HTML code for page with shadow roots

I am trying to download the HTML code for the website intersight.com/help/. But puppeteer is not returning the HTML code with hrefs as we can see in the page (e

Selecting value in drop down list in Chrome recorder

I am trying to record a web workflow using the Chrome inbuilt recorder. When selecting a value from a drop down list, the following code is generated. "type":

Return observable while doing task - Firebase Functions

I have a function in my Firebase Cloud Functions that needs to run a scraping task. While the function is scraping the public website I need to return to the co

How to get children of elements by Puppeteer

I understand that puppeteer get its own handles rather than standard DOM elements, but I don't understand why I cannot continue the same query by found elements

Disk usage is increasing with puppeteer - chromium installed using snap

I have installed chromium using snap install chromium on my Ubuntu server with Arm cpu because when I wanted to install puppeteer using npm it throwed errors, I

Running Puppeteer on WSL2 controlling the Chrome on Windows

I'm trying to get to run puppeteer on WSL2. I've tried using a remote display via VcXsvr but my firewall settings and host have custom changes and I've frankly

Changing user-agent on puppeteer-extra doesn't seem to take affect

I'm trying to scrape different websites using puppeteer. As I'm using puppeteer-extra for that (for their stealth-plugin), I've decided to use their anonymize-u