Deani1232
Deani1232
RRailway
Created by Deani1232 on 9/1/2024 in #✋|help
Max file limits
I'm planning to implement a CouchDb database that is likely to have thousands of very small databases. I'm planning on using the standard railway install with volume attachment, but I'm wondering if I need to engineer a way to cluster them out or not (yet) based on the limitations of this structure. Since each database has a separate file (at least that's my understanding), this can cause issues in unix systems with max files in a directory/max files accessed at once. I'm not expecting a ton of databases to all be open at one time, but it might be close to 500ish. I don't think it should cause issues, but I wanted to ask from an infrastructure standpoint if it's likely to hit resource limits. This is the documentation page on resource limits from CouchDb: https://docs.couchdb.org/en/stable/maintenance/performance.html Not sure how this works internally so if someone who's more familiar with this server setup can help me out, that'd be awesome!
7 replies
RRailway
Created by Deani1232 on 6/30/2024 in #✋|help
Why is Hasura using so much RAM?
Just got an outrageously high bill caused by our Hasura based server. Is this normal? Why would Hasura be using 16 gigs of RAM? How do we fix this? I was not expecting a 3x increase in our bill this month... something has to be wrong here, this service is hardly even used.
24 replies
RRailway
Created by Deani1232 on 4/12/2024 in #✋|help
NestJS app - no access to server with Railway domain
No description
10 replies
RRailway
Created by Deani1232 on 4/12/2024 in #✋|help
Problem processing request (for github repo deployment)
No description
5 replies
RRailway
Created by Deani1232 on 3/9/2024 in #✋|help
Did the team overwrite database vars?
UPDATE: I didn't know what I was doing Hey I think I'm going crazy. Multiple of my database vars are randomly empty across different projects and services as of two days ago. Even stranger, one of the projects had variables cleared out on one environment but not the other. This didn't happen to all environments, but it looks like specifically it was the ones with the older DB names such as "PGHOST" or "PGPASSWORD". The newer names such as "POSTGRES_USER" seem to have been untouched. Am I crazy? Was this a mistake with the DB migration logic? It didn't kill anything super important due to being really careful surrounding the important DB migrations, but now I'm paranoid.
17 replies
RRailway
Created by Deani1232 on 3/8/2024 in #✋|help
Open Telemetry with HyperDX
This is not exactly a Railway question but someone here might know the answer. I am trying to get a basic Open Telemetry setup with NestJS to export logs to HyperDX. The opentel data outputs to railway console, but I can't seem to get it to output to the HyperDX endpoint. Their documentation is terrible so I think I'm lost in an implementation detail. This is my tracing file as of now:
import {
ConsoleSpanExporter,
SimpleSpanProcessor,
} from "@opentelemetry/sdk-trace-base";
import { NodeSDK } from "@opentelemetry/sdk-node";
import { HttpInstrumentation } from "@opentelemetry/instrumentation-http";
import { ExpressInstrumentation } from "@opentelemetry/instrumentation-express";
import { NestInstrumentation } from "@opentelemetry/instrumentation-nestjs-core";
import { GraphQLInstrumentation } from "@opentelemetry/instrumentation-graphql";
import { OTLPTraceExporter } from "@opentelemetry/exporter-trace-otlp-grpc";
import { CompressionAlgorithm } from "@opentelemetry/otlp-exporter-base";

const traceExporter = new ConsoleSpanExporter();
const oltpExporter = new OTLPTraceExporter({
url: "https://in-otel.hyperdx.io:4317",
headers: {
authorization: `Bearer ${process.env.HYPER_DX_API_KEY}`,
},
compression: CompressionAlgorithm.GZIP,
timeoutMillis: 10000,
});

export const otelSDK = new NodeSDK({
spanProcessors: [
new SimpleSpanProcessor(oltpExporter),
new SimpleSpanProcessor(traceExporter),
],
instrumentations: [
new HttpInstrumentation(),
new ExpressInstrumentation(),
new NestInstrumentation(),
new GraphQLInstrumentation(),
],
});

// gracefully shut down the SDK on process exit
process.on("SIGTERM", () => {
otelSDK
.shutdown()
.then(
() => console.log("SDK shut down successfully"),
(err) => console.log("Error shutting down SDK", err),
)
.finally(() => process.exit(0));
});
import {
ConsoleSpanExporter,
SimpleSpanProcessor,
} from "@opentelemetry/sdk-trace-base";
import { NodeSDK } from "@opentelemetry/sdk-node";
import { HttpInstrumentation } from "@opentelemetry/instrumentation-http";
import { ExpressInstrumentation } from "@opentelemetry/instrumentation-express";
import { NestInstrumentation } from "@opentelemetry/instrumentation-nestjs-core";
import { GraphQLInstrumentation } from "@opentelemetry/instrumentation-graphql";
import { OTLPTraceExporter } from "@opentelemetry/exporter-trace-otlp-grpc";
import { CompressionAlgorithm } from "@opentelemetry/otlp-exporter-base";

const traceExporter = new ConsoleSpanExporter();
const oltpExporter = new OTLPTraceExporter({
url: "https://in-otel.hyperdx.io:4317",
headers: {
authorization: `Bearer ${process.env.HYPER_DX_API_KEY}`,
},
compression: CompressionAlgorithm.GZIP,
timeoutMillis: 10000,
});

export const otelSDK = new NodeSDK({
spanProcessors: [
new SimpleSpanProcessor(oltpExporter),
new SimpleSpanProcessor(traceExporter),
],
instrumentations: [
new HttpInstrumentation(),
new ExpressInstrumentation(),
new NestInstrumentation(),
new GraphQLInstrumentation(),
],
});

// gracefully shut down the SDK on process exit
process.on("SIGTERM", () => {
otelSDK
.shutdown()
.then(
() => console.log("SDK shut down successfully"),
(err) => console.log("Error shutting down SDK", err),
)
.finally(() => process.exit(0));
});
This is the docs page from their website: https://www.hyperdx.io/docs/install/opentelemetry
8 replies
RRailway
Created by Deani1232 on 3/3/2024 in #✋|help
Typesense Template Port
No description
10 replies
RRailway
Created by Deani1232 on 2/12/2024 in #✋|help
Can services be located in several regions?
Can I use the load-balancer to have a Singapore server and a US server on railway? A lot of my users are in SEA.
7 replies
RRailway
Created by Deani1232 on 1/31/2024 in #✋|help
What was different about this DDoS attack vs the last one?
This is not a complaint, it's a legitimate question. I've had to issue multiple refunds this month due to DDoS attacks on the infrastructure lasting 5+ hours. With the last DDoS attack, we were told there was a 5 minute fix going forward. I know DDoS attacks can't be avoided really, but I'm wondering why the solution from the last time couldn't be used for this time around. Is it a different kind of attack? I'm looking to learn how to prevent this kind of outage in the future, as I can't keep answering support tickets from the same customers about the same issues. They think there is something wrong with my app. This is not an urgent ticket, so just respond when available and willing.
7 replies
RRailway
Created by Deani1232 on 1/24/2024 in #✋|help
Is there an easy way to implement Debezium CDC on a railway postgres db?
I want to be able to log all changes to my postgres databases via CDC, would be cool if there's an easy way to do it. Ideally I want to stream this into Kafka (out of scope).
4 replies
RRailway
Created by Deani1232 on 1/24/2024 in #✋|help
Can I sort logs to only show errors?
Is there a filter that only shows errors, not all logging output via the railway console?
9 replies
RRailway
Created by Deani1232 on 1/24/2024 in #✋|help
Problems with routing layer again?
Having the same problem I had a few weeks ago where all of my pager services are responding intermittently down at the same time. Had multiple instances where the servers were not reachable. DDoS part 2?
4 replies
RRailway
Created by Deani1232 on 1/18/2024 in #✋|help
Getting intermittent connection errors on all services connected to my uptime kuma.
No description
78 replies
RRailway
Created by Deani1232 on 1/15/2024 in #✋|help
Is there a way to get the replica ID from an environment variable or otherwise?
I want to set up a pager to the different replicas of my app server. Was wondering if it's possible to get a replica ID local to the machine and include that in the ping to Uptime Kuma.
22 replies
RRailway
Created by Deani1232 on 1/11/2024 in #✋|help
Our n8n instances have possibly started crashing with the PG bouncer / new database setup
No description
24 replies
RRailway
Created by Deani1232 on 1/10/2024 in #✋|help
Can variable refs to databases be shared between projects?
Can I use variable refs in the environment vars outside of a specific project to share db ref between two services in different projects?
4 replies
RRailway
Created by Deani1232 on 1/10/2024 in #✋|help
Can the CLI api be used to spawn a v1 db?
I see that the CLI can be used to spawn a postgres database here in the docs: https://docs.railway.app/reference/cli-api#add Does this spawn up an old db or a new one? Is there a way to spawn an old one via a different plugin name?
14 replies
RRailway
Created by Deani1232 on 1/9/2024 in #✋|help
How do I know if I am on the new n8n template or the old template?
Since the db migrations break the n8n (Tini issue), how do I know if a particular service is safe to migrate using the script or not?
126 replies
RRailway
Created by Deani1232 on 1/9/2024 in #✋|help
Is this a Railway DB related issue?
No description
4 replies
RRailway
Created by Deani1232 on 1/6/2024 in #✋|help
How do I rollback an environment to before running the migration script?
I tried to use the database migration script in a project filled of 6 utility services. This included 2 database backup services and an uptime kuma service. I no longer can log into my uptime kuma services, it overwrote data in my backup services I think, and the only service that's working in this project now is a service that doesn't use a database and the main service that the project was created on (listmonk). I don't even know where Uptime Kuma's service was pointing to, as it must have had a database, but now because I can't log in, it looks like it's just gone. If I had the old database connection information, I would be able to figure this out. Can I see old environment variables or rollback the environment variables? How do I roll back this change of the database migration script?
4 replies