themkrage Comments - Answer Overflow

Topics

themkrage

•Created by themkrage on 8/14/2024 in #✋｜help

Is Railway down?

98f66160-ce86-4b15-a73b-cab912256208

21 replies

•Created by themkrage on 7/11/2024 in #✋｜help

Node Memory and CPU Usage is low

How can I do this with Railway? the batch will stills be run on the same railway hardware no? Can replica's handle this/

15 replies

•Created by themkrage on 7/11/2024 in #✋｜help

Node Memory and CPU Usage is low

any update @Brody

15 replies

•Created by themkrage on 7/11/2024 in #✋｜help

Node Memory and CPU Usage is low

Thanks for the idea! Is there some way to run like X workers per batch on Railway on different instances or something? It seems one railway instance is not enough to run this job

15 replies

•Created by themkrage on 7/11/2024 in #✋｜help

Node Memory and CPU Usage is low

low, like 4-6 gb memory, and 1-2 vCPU on Railway the job never completes! I let it run for 3-4 straight days. Locally it completes in 12 hours The job makes a large amount of database calls, then parses location data. The database is not the blocker though, its the local compute that checks various @turf / geojson functions

15 replies

•Created by themkrage on 7/11/2024 in #✋｜help

Node Memory and CPU Usage is low

98f66160-ce86-4b15-a73b-cab912256208

15 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

not quite? we use it scrape information that powers our product, but its not like we sell the scraping as a service

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

hmm

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

they have a license required on their site to self-host, so i assumed you had to pay

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

Thank you, can try it out

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

and this is something we get to use

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

So does Railway pay to host Browserless then?

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

So how can I use this? I can look around, but i seems like you put the browserless url from this instance into your pupeteer initializer?

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

Yes I do

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

Perhaps I'm confused what this does

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

oh

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

I do not want to purchase Browserless as I need to do mass amounts of scraping. The job runs locally using Pupeteer, so why would I need to purchase Browserless?

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

Yes, but you need a Browserless subscription to use this

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

I do not want to pay for a browserless subscription and was hoping to host all on Railway. Browserless is quite pricy I believe

27 replies

•Created by themkrage on 6/12/2024 in #✋｜help

Puppeteer Hangs

https://railway.app/project/98f66160-ce86-4b15-a73b-cab912256208/service/eed3c125-3b7c-4126-b8c4-5a04a97e22e2?id=52934b4d-c4db-4aaa-8e18-6cb28ad3ed21

27 replies