MCP
{
  "mcpServers": {
    "bundlephobia": {
      "url": "https://bundlephobia.com/api/mcp"
    }
  }
}
Menu

node-webcrawler

Created with Sketch.Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
DependenciesCreated with Sketch.10 dependencies
Ignoring the size of missing dependency  hiredis.Read more

Bundle Size

2
MB
Minified
624.1
kB
Minified + Gzipped

Download Time

12.48
s
Slow 3G
i
0.71
s
Emerging 4G
i

Composition

iconv-lite
12.9%
mongodb
10.7%
parse5
10.6%
tough-cookie
7.6%
mongodb-core
6.9%
mime-db
6.6%
ioredis
5.3%
sshpk
5.2%
whacko
4.0%
bluebird
3.3%
bson
2.8%
htmlparser2
2.7%
lodash
2.5%
request
1.8%
entities
1.6%
tweetnacl
1.6%
(others)
14.1%

Note: These sizes represent the contribution made by dependencies (direct or transitive) to node-webcrawler's size. These may be different from the dependencies' standalone sizes.

Exports Analysis

Exports analysis is available only for packages that export ES Modules and are side-effect free.
This package does not export ES6 modules.