I am trying to get info about all the elements with a particular class name into an array.

The problem is this is a dynamically generated HTML page, and as long as I scroll down, new elements of that class name appear.

Fortunately, I know beforehand how many of these elements exist.

So my hypothetical solution is to check the number of elements with that particular class name, and as long as that number is less than the one I know, keep scrolling down.

The problem is I don't know exactly how to count elements of a particular class name inside puppeteer and the API was not very useful either.

I am trying to get info about all the elements with a particular class name into an array.

The problem is this is a dynamically generated HTML page, and as long as I scroll down, new elements of that class name appear.

Fortunately, I know beforehand how many of these elements exist.

So my hypothetical solution is to check the number of elements with that particular class name, and as long as that number is less than the one I know, keep scrolling down.

The problem is I don't know exactly how to count elements of a particular class name inside puppeteer and the API was not very useful either.

• javascript
• node.js
• puppeteer

• Somethig like getElementsByClassName(".someclass").length ? – Jonas Wilms Commented Jun 1, 2018 at 14:36
• Will this work in my case in puppeteer? – user1584421 Commented Jun 1, 2018 at 18:39

1 Answer 1

I think this is what you are looking for

const puppeteer = require('puppeteer')

async function count () {
  const browser = await puppeteer.launch()
  const page = await browser.newPage()
  await page.goto('https://news.ycombinator.com', {waitUntil: 'networkidle2'})
  await page.evaluate(_ => {
    window.scrollBy(0, window.innerHeight)
  })

  console.log('how many?', (await page.$$('td.title')).length)

  await browser.close()
}

count()