Newbie needs help
Hi everyone.
I'm new to python and I'm trying to deploy my first mini project to Railway.
I keep getting this message in the Deploy log. Could anyone tell me what the actual problem is? The program works fine localy in VS code.
Thanks alot in advance.
30 Replies
Project ID:
N/Adid you need to install chromedriver on your pc to get the program working?
NA
I think so. i had this file in the same folder as the program but i removed it to see if it would work without it. Im not sure if anything is installed on my pc.
may I ask what you are using selenium for?
its to extract information from a website.
you will most likely need to make up a dockerfile that has chromedriver installed. if that is even a thing that's allowed on railway
but also, do you actually need chromedriver? most websites are parsed just fine without it (and worst comes to worst you can probably use Scrapy)
I'm sorry but web scraping is a big grey area, it's even in railways TOS
it's generally frowned upon
Is it? i diden't know that. Its only to check if there is a new episode out becuase the site has no notefication alert in any form
okay i just actually read the TOS, you are not allowed to use anything that:
typically if they don't allow scraping they will normally have an API
and if they don't have an api, you'll want to look for a similar api from a different platform
but also to be honest this sounds like you could probably run on your home pc and you wouldn't need to get into trouble with a service for using something against the tos 😂
unless you're trying to wait until like 2am in the morning for an episode in which case... ok
yep, so with all that said, I'm really sorry but we can't help you achieve something that's stated in the tos
railway would just rather not deal with any takedown requests for misbehaving bots, so it's generally just not really allowed
I hope you can understand
I understand. Ss requests also considered TOS?
what
is python module "requests" also considered web-scraping?
if you are requesting a web page, it absolutely counts
if you are requesting an api, no that's fine
I have a feeling this is anime related?
Okay so next step is to check if the site has an API i can use if not just abandon this project on railway
it's considered web scraping when you are programmatically requesting the contents of a HTTP web page and then parsing the data from it for usage in some way later on
josh is saying some very smart words
so for example if you write a program in py that grabs the contents of google.com to use in a spreadsheet report later, that basically counts as web scraping
(whether you use selenium or beautifulsoup)
and Google really doesn't like that
Google has a search api fun fact, and it's pretty good too
I understand. I also just has to clarify that i actuala have never wathed anime
haha i only asked because I've seen a lot of similar projects that had to do with anime, and I had an api recommendation for you 🙂
thanks anyways. Since i dont wanna break the TOS, what is the easyest way to run a scrips on your own pc without using VS cods terminal?
assuming windows, put a shortcut to start the script in your startup folder
do i need to make the .py file to an .exe? just asking since i dont know anything at this stage of programmming.
no you don't, but from here on out your questions are far better suited for a search engine, as this is railway platform help
im greatfull for the help and the conversation. Have a nice day fox
you too cat