Railway•10mo ago

Scraping error

Hey! I have set up a web scraping script on railway. It runs sometimes and sometimes not. It works perfectly on local. Thanks!

node:internal/process/promises:288

triggerUncaughtException(err, true /* fromPromise */);

^

page.goto: net::ERR_NETWORK_CHANGED at https://URL.URL  .com/dashboard

Call log:

- navigating to "https://URL.URL.com/dashboard";, waiting until "load"

at scrape (/app/scrape.js:24:14) {

name: 'Error'

}

node:internal/process/promises:288

triggerUncaughtException(err, true /* fromPromise */);

^

page.goto: net::ERR_NETWORK_CHANGED at https://URL.URL  .com/dashboard

Call log:

- navigating to "https://URL.URL.com/dashboard";, waiting until "load"

at scrape (/app/scrape.js:24:14) {

name: 'Error'

}

Changed URL for privacy reasons. Project id: fa490f43-36ac-4e94-9ac9-1ce2b0b5365b

2 Replies

Percy•10mo ago

Project ID: fa490f43-36ac-4e94-9ac9-1ce2b0b5365b

Brody•10mo ago

web scraping is something that's listed in railways TOS, so while this error isn't something caused by railway trying to stop you, it's not something we would really want to help support unfortunately, unless you have explicit permission to scrape what you're scraping?

Gaming

Programming

Scraping error