What are the best CI/CD tools to use?
I know ci/cd might seem a little bloated, but my siblings and are all working together on multiple side projects. I would like to say that these are more serious than typical tinder/twitter app clones and are web apps or projects we intend to make some profit off of. That being said, we are trying to incorporate more enterprise level practices and tools in terms of deployment and scaling. A lot of what we are doing is obviously overkill and not needed, but I think it can help me learn a lot about managing and building larger projects.
I've been using and learning Jenkins but a lot of other people i've talked to on other discords/situations always shake their heads when I bring it up and say that Jenkins is waaaay outdated and a pain to work with. I've heard (from my brother who did contracting work for) doordash and other companies use Jenkins servers where they run thousands of builds a day, but I can see this being due to them being tied to legacy infrastructure. I personally feel Jenkins is mostly fine other than potentially a few security issues and some configuration hell, but I haven't worked intensely with other CI/CD tools. It would be nice, interesting and hopefully useful to learn some common CI/CD tools that won't be super dated, but are still flexible and configurable.
Would any of you mind describing an ideal, scalable and enterprise level ci/cd pipeline you would use for (deploying, building, testing...) webapps and any other sort of large scale project? I know most of this may depend on the nature of the project and situation itself, but I am looking for pros and cons, as well as common practices/tools.
5 Replies
for a large project with many developers, the biggest gains come from
1. parallelizing
2. not having to run the whole pipeline every time no matter what the change is
imo start looking at monorepo tooling like nx or turborepo, the ci/cd situation derives from that
most "enterprise" ci/cd pipelines are bad btw, like most enterprise projects in general
ah, go figure
Agent
YouTube
Miroslav Jonaš & Rareș Matei: Don’t let compilation set the length ...
- Miroslav Jonaš and Rareș Matei's talk at AgentConf 2023 sheds light on optimizing the compilation process in software development workflows to minimize downtime and maximize productivity.
- They explore strategies for reducing build times and improving the developer experience by leveraging caching, incremental builds, and smart dependency man...
this is an ad for nx obviously, but the concepts are similar everywhere
github actions