
Steve Petrie, P.Eng. via talk wrote:
Headless Chrome and the Puppeteer Library for Scraping and Testing the Web Wednesday 29 November http://www.i-programmer.info/news/87/11344.html
With the advent of Single Page Applications, scraping pages for information as well as running automated user interaction tests has become much harder due to its highly dynamic nature. The solution? Headless Chrome and the Puppeteer library. ... There's just one caveat. Since CDP only works with Chromium, Chrome and other Blink-based browsers, so does Puppeteer. If you require more than that, then sticking to Selenium and its WebDriver API still remains the best option.. ===
The Selenium WebDriver API might be a useful code base to be considered, in the design of the p'n'c "subversive incremental load" browser ...
My 2 cents worth.
Thought this was a interesting idea so I prototyped it in Jupyter: <https://github.com/myles/notebooks/blob/master/Random/2017-12-15-better-web-browser/notebook.ipynb> My 2 cents worth of programming :-).