Category "puppeteer"

How can I get an element by xpath?

I need to find any element in DOM by xpath. I already tried the following: let el = await page.$x('//*[@id="readium-right-panel"]/ul/li[1]'); The returning e

Puppeteer not giving accurate HTML code for page with shadow roots

I am trying to download the HTML code for the website intersight.com/help/. But puppeteer is not returning the HTML code with hrefs as we can see in the page (e

Selecting value in drop down list in Chrome recorder

I am trying to record a web workflow using the Chrome inbuilt recorder. When selecting a value from a drop down list, the following code is generated. "type":

Return observable while doing task - Firebase Functions

I have a function in my Firebase Cloud Functions that needs to run a scraping task. While the function is scraping the public website I need to return to the co

How to get children of elements by Puppeteer

I understand that puppeteer get its own handles rather than standard DOM elements, but I don't understand why I cannot continue the same query by found elements

Disk usage is increasing with puppeteer - chromium installed using snap

I have installed chromium using snap install chromium on my Ubuntu server with Arm cpu because when I wanted to install puppeteer using npm it throwed errors, I

Running Puppeteer on WSL2 controlling the Chrome on Windows

I'm trying to get to run puppeteer on WSL2. I've tried using a remote display via VcXsvr but my firewall settings and host have custom changes and I've frankly

Changing user-agent on puppeteer-extra doesn't seem to take affect

I'm trying to scrape different websites using puppeteer. As I'm using puppeteer-extra for that (for their stealth-plugin), I've decided to use their anonymize-u

How can I download images on a page using puppeteer?

I'm new to web scraping and want to download all images on a webpage using puppeteer: const puppeteer = require('puppeteer'); let scrape = async () => {

Puppeteer wait until page is completely loaded

I am working on creating PDF from web page. The application on which I am working is single page application. I tried many options and suggestion on https://g

Override the browser date with puppeteer

I'm trying to setup puppeteer to run a few performance tests. I'd like to override the date to a specific value so that I can mock the data my app needs without

PM2 does not restart Node JS application when this error occurs

For some reason, every time I get this particular error /home/pi/.pm2/logs/app-error.log last 15 lines: 0|scripts | { TimeoutError: Navigation timeout of 30000

Selecting element from DOM with Puppeteer and Node

I am using Node and Puppeteer to scrape some information from webpage I am having issues with selecting the right elements. This describes the exact situation.

'You Look Like a Robot' Error , while using puppeteer in firebase cloud functions

Im using the puppeteer package , in order to scrap a web page data that is fetched by clicking a button in this page this are the presetting that I'm using: con

M1 chip, Install Puppeteer in Docker NodeJs, The chromium binary is not available for arm64

I got an error while building backend docker, specifically installing Puppeteer. I'm using M1 MacBook, and I found a solution on the local machine(https://githu