Railway•16mo ago

Error: read ECONNRESET at TCP.onStreamRead

Now and then I get the exception below. I have to make the same request 3 times before I get a response from my NestJS API app. [Nest] 32 - 08/03/2023, 8:08:30 AM ERROR [ExceptionsHandler] select * from "municipalities" order by "name" asc - read ECONNRESET Error: read ECONNRESET at TCP.onStreamRead (node:internal/stream_base_commons:217:20) Connection Error: Connection ended unexpectedly The above log is from NestJS API log. Can someone point me in the right direction?

35 Replies

Percy•16mo ago

Project ID: 79b7240f-dddf-498a-a330-e4ecb87b23f3

xbisaOP•16mo ago

79b7240f-dddf-498a-a330-e4ecb87b23f3

Brody•16mo ago

what package are you using for the database?

xbisaOP•16mo ago

I'm using knex and nestjs-knex.

Brody•16mo ago

can I see your connection code?

xbisaOP•16mo ago

sure

import { Injectable } from '@nestjs/common';
import { InjectKnex, Knex } from 'nestjs-knex';
import { Municipality } from '@xbisa#1020/appability';
import { permittedFieldsOf } from '@casl/ability/extra';
import { hasKeys } from '../service-helpers';
import { pick } from 'lodash';
import { plainToInstance } from 'class-transformer';

@Injectable()
export class MunicipalitiesService {
  constructor(@InjectKnex() private readonly knex: Knex) {}

  public async findAll(request: any): Promise<{ data: Array<Municipality> }> {
    const dbMunicipalities = await this.knex
      .select('*')
      .from('municipalities')
      .orderBy('name');

    const municipalities: Municipality[] = plainToInstance(
      Municipality,
      dbMunicipalities,
    );

    const data: Municipality[] = municipalities
      .map((municipality: Municipality) => {
        const fields: string[] = permittedFieldsOf(
          request.ability,
          'read',
          municipality,
          {
            fieldsFrom: (rule) => {
              return rule.fields || [];
            },
          },
        );
        return pick(municipality, fields) as Municipality;
      })
      .filter((municipality: Municipality) => {
        return hasKeys(municipality);
      });

    return { data };
  }
}

import { Injectable } from '@nestjs/common';
import { InjectKnex, Knex } from 'nestjs-knex';
import { Municipality } from '@xbisa#1020/appability';
import { permittedFieldsOf } from '@casl/ability/extra';
import { hasKeys } from '../service-helpers';
import { pick } from 'lodash';
import { plainToInstance } from 'class-transformer';

@Injectable()
export class MunicipalitiesService {
  constructor(@InjectKnex() private readonly knex: Knex) {}

  public async findAll(request: any): Promise<{ data: Array<Municipality> }> {
    const dbMunicipalities = await this.knex
      .select('*')
      .from('municipalities')
      .orderBy('name');

    const municipalities: Municipality[] = plainToInstance(
      Municipality,
      dbMunicipalities,
    );

    const data: Municipality[] = municipalities
      .map((municipality: Municipality) => {
        const fields: string[] = permittedFieldsOf(
          request.ability,
          'read',
          municipality,
          {
            fieldsFrom: (rule) => {
              return rule.fields || [];
            },
          },
        );
        return pick(municipality, fields) as Municipality;
      })
      .filter((municipality: Municipality) => {
        return hasKeys(municipality);
      });

    return { data };
  }
}

It's not a problem relating to this endpoint

Brody•16mo ago

do me a favour and enclose that code with triple backticks?

xbisaOP•16mo ago

just a second

Brody•16mo ago

but I'd like to see the code that connects to the database, that doesn't have anything to do with connecting to the database

xbisaOP•16mo ago

Oh I see

Brody•16mo ago

and remember, triple backticks please

xbisaOP•16mo ago

I'm doing that in my app.module.ts

@Module({
  imports: [
    ConfigModule.forRoot({
      load: [configuration],
      isGlobal: true,
    }),
    KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
        },
      },
    }),
  ],
  controllers: [AppController],
  providers: [AppService],
})
export class AppModule implements NestModule {
  // eslint-disable-next-line @typescript-eslint/no-empty-function,@typescript-eslint/no-unused-vars
  configure(consumer: MiddlewareConsumer): any {}
}

@Module({
  imports: [
    ConfigModule.forRoot({
      load: [configuration],
      isGlobal: true,
    }),
    KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
        },
      },
    }),
  ],
  controllers: [AppController],
  providers: [AppService],
})
export class AppModule implements NestModule {
  // eslint-disable-next-line @typescript-eslint/no-empty-function,@typescript-eslint/no-unused-vars
  configure(consumer: MiddlewareConsumer): any {}
}

Brody•16mo ago

show me the configuration().database code please

xbisaOP•16mo ago

export default () => ({
  port: +process.env.API_PORT,
  database: {
    host: process.env.DATABASE_HOST,
    port: +process.env.DATABASE_PORT,
    database: process.env.DATABASE,
    user: process.env.DATABASE_USER,
    password: process.env.DATABASE_PASSWORD,
  },
});

export default () => ({
  port: +process.env.API_PORT,
  database: {
    host: process.env.DATABASE_HOST,
    port: +process.env.DATABASE_PORT,
    database: process.env.DATABASE,
    user: process.env.DATABASE_USER,
    password: process.env.DATABASE_PASSWORD,
  },
});

this is my configuration.ts

Brody•16mo ago

I assume this is for postgres

xbisaOP•16mo ago

yes

Brody•16mo ago

in the config object can you please add this

pool: { min: 0, max: 10 }

pool: { min: 0, max: 10 }

and show me the code again after that change?

xbisaOP•16mo ago

2 sec

export default () => ({
  port: +process.env.API_PORT,
  database: {
    host: process.env.DATABASE_HOST,
    port: +process.env.DATABASE_PORT,
    database: process.env.DATABASE,
    user: process.env.DATABASE_USER,
    password: process.env.DATABASE_PASSWORD,
    pool: { min: 0, max: 10 },
  },
});

export default () => ({
  port: +process.env.API_PORT,
  database: {
    host: process.env.DATABASE_HOST,
    port: +process.env.DATABASE_PORT,
    database: process.env.DATABASE,
    user: process.env.DATABASE_USER,
    password: process.env.DATABASE_PASSWORD,
    pool: { min: 0, max: 10 },
  },
});

Like this?

Brody•16mo ago

no, not quite in the config object can you please add this

pool: { min: 0, max: 10 }

pool: { min: 0, max: 10 }

xbisaOP•16mo ago

KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
          pool: { min: 0, max: 10 },
        },
      },
    }),

KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
          pool: { min: 0, max: 10 },
        },
      },
    }),

is this better?

Brody•16mo ago

no, you aren't putting it where I'm saying to the pool object goes in the config object

xbisaOP•16mo ago

yes, I see now from the doc

Brody•16mo ago

alright show code please

xbisaOP•16mo ago

KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
        },
        pool: { min: 0, max: 10 },
      },
    })

KnexModule.forRoot({
      config: {
        client: 'pg',
        connection: {
          ...configuration().database,
        },
        pool: { min: 0, max: 10 },
      },
    })

Brody•16mo ago

there we go pool is now in config

xbisaOP•16mo ago

what is the significance of pool? Yes

Brody•16mo ago

one sec, let me find that info for you now this is for strapi, but the exact same information applies to you since you are using knex too, read the caution blurb https://docs.strapi.io/dev-docs/configurations/database#database-pooling-options

xbisaOP•16mo ago

are services at Railway hosted by docker containers?

Brody•16mo ago

yes they are

xbisaOP•16mo ago

Then I understand the issue Thanks for helping resolve my issue

Brody•16mo ago

alrighty then, let me know if you continue to see this issue after you deploy this change!

xbisaOP•16mo ago

Okay, I will deploy and see if it solves the problem, hopefully it will

Brody•16mo ago

awesome

xbisaOP•16mo ago

Hello Brody. Everything looks good since deployment of pool object. Thanks again for great support, it's a big incentive for us to stay on Railway platform.

Brody•16mo ago

I'm happy to hear that, I'm glad I could help you 🙂

Gaming

Programming

Error: read ECONNRESET at TCP.onStreamRead