'Not getting all the html data in the devtools on zillow website (and other)
I'm trying to scrape real estate data from zillow. When I look the html code on the devtool, most of the links of the house details are not displayed in the html code. Whereas we click on every houses cards to get the details of the house associated. I get these errors and warning in the console of the devtool :
New York City NY Single Family Homes
I searched solutions to solve these problem, but I didn't find ways to fix it. Disabling JavaScript source maps only hide warnings. I checked if chrome is updated. I'm using beautifulsoup to scrape the data, and I tried to combine it with selenium. But I still get empty values for 31 out of 40 links of house details.
I thank you in advance if you have any ideas that can help.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|