Replacing the default script with a custom start script We're also adding the typescript package, alongside the types for Cheerio and Node, and initialising a default tsconfig.json configuration file for TypeScript. We're creating a new project here, named node-js-scraper, with the Cheerio NPM package installed.
#Single cheerio install
Npm install -save-dev typescript tsc -init The bash commands to setup the project "username": The expected array of User objects Setupįirst things first, lets create a new project, by running the following commands: mkdir node-js-scraper We should end up with the following array: [ We'll be using the first table on the webpage to do this. Our goal is to parse this webpage, and produce an array of User objects, containing an id, a firstName, a lastName, and a username. In this post we'll be utilising TypeScript to provide a shape for a User object.
TypeScript is a powerful means of validating JavaScript prior to runtime.
CSS selectors can be perfected in the browser, for example using Chrome's developer tools, prior to being used with Cheerio. This allows us to leverage existing front-end knowledge when interacting with HTML in NodeJS. We will use a website specifically set up for practicing scraping (thanks webscraper.io!) which provides a web page with several tables.Ĭheerio is an NPM package that allows us to parse HTML using CSS selectors outside of the browser. In this post we will leverage NodeJS, TypeScript, and Cheerio to quickly build out a web page scraper.
0 kommentar(er)
