Xata•2y ago

Re-executing Drizzle Kit push fails after successful push

I'm getting the following error:

PL/pgSQL function "xata.pg_catalog".regnamespace(text) line 14 at RAISE

PL/pgSQL function "xata.pg_catalog".regnamespace(text) line 14 at RAISE

> pnpx drizzle-kit push
drizzle-kit: v0.21.4
drizzle-orm: v0.30.10

No config path provided, using default path
Reading config file '/redacted/apps/partner-tool/app/drizzle.config.ts'
Using 'pg' driver for database querying
[⣟] Pulling schema from database.../redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:69429
        Error.captureStackTrace(err2);
              ^

error: schema "publics" does not exist
    at /redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:69429:15
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.query (/redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:111366:26)
    at async /redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:15979:46 {
  length: 166,
  severity: 'ERROR',
  code: 'P0001',
  detail: undefined,
  hint: undefined,
  position: undefined,
  internalPosition: undefined,
  internalQuery: undefined,
  where: 'PL/pgSQL function "xata.pg_catalog".regnamespace(text) line 14 at RAISE',
  schema: undefined,
  table: undefined,
  column: undefined,
  dataType: undefined,
  constraint: undefined,
  file: 'pl_exec.c',
  line: '3923',
  routine: 'exec_stmt_raise'
}

> pnpx drizzle-kit push
drizzle-kit: v0.21.4
drizzle-orm: v0.30.10

No config path provided, using default path
Reading config file '/redacted/apps/partner-tool/app/drizzle.config.ts'
Using 'pg' driver for database querying
[⣟] Pulling schema from database.../redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:69429
        Error.captureStackTrace(err2);
              ^

error: schema "publics" does not exist
    at /redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:69429:15
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.query (/redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:111366:26)
    at async /redacted/node_modules/.pnpm/drizzle-kit@0.21.4_@esbuild-kit+esm-loader@2.6.5_commander@10.0.1_drizzle-orm@0.30.10_@neonda_jne73tzufwvw4dok65xkag4jqi/node_modules/drizzle-kit/bin.cjs:15979:46 {
  length: 166,
  severity: 'ERROR',
  code: 'P0001',
  detail: undefined,
  hint: undefined,
  position: undefined,
  internalPosition: undefined,
  internalQuery: undefined,
  where: 'PL/pgSQL function "xata.pg_catalog".regnamespace(text) line 14 at RAISE',
  schema: undefined,
  table: undefined,
  column: undefined,
  dataType: undefined,
  constraint: undefined,
  file: 'pl_exec.c',
  line: '3923',
  routine: 'exec_stmt_raise'
}

Is this an error with Xata or Drizzle? It loks like Xata.
Also, I'm not referencing

publics

publics

anywhere. Which seems like a typo?

kostas•6/10/24, 2:03 PM

Hi, I believe this is a known issue and we're working on a fix. It should be available very soon.

Michael SchaufelbergerOP•6/10/24, 2:16 PM

Ah, ok, thank you. In the meantime I've found that the issue is triggered by the use of a composite primary key:

Michael SchaufelbergerOP•6/10/24, 2:17 PM

After successfully pushing this. Drizzle cannot introspect the db again and it results in the above error.

kostas•6/10/24, 2:18 PM

Can you specify your workspace id please, so we can check for logs in more depth?

kostas•6/10/24, 2:19 PM

Also a timestamp when this occurs would help us

Michael SchaufelbergerOP•6/10/24, 2:21 PM

Sure.
5713tr is the id
and the timestamp is basically for the last 20mins

Michael SchaufelbergerOP•6/10/24, 2:21 PM

Do you need it more specific?

kostas•6/10/24, 2:26 PM

We've seen this issue before and the dev team confirmed that we've pushed a fix for it, but there may be more conditions that it manifests under.

Would you be able to send us (here, or at support@xata.io if you don't want to post it in public) the drizzle schema you're using so we can reproduce?

Michael SchaufelbergerOP•6/10/24, 2:36 PM

In this case it's fine, since it's pretty generic:

This is what drizzle kit with config produces

table.ts

helpers.ts

Note: the columns like are just aliases.

kostas•6/10/24, 2:51 PM

Thank you, we can reproduce the issue. I am following up with the dev team and will let you know as soon as we have an update.

kostas•6/13/24, 11:23 AM

Hi, we've just merged a fix for this issue. Can you try again and let me know if things work this time?

Michael SchaufelbergerOP•6/22/24, 11:07 AM

Thanks!
~~Hmm, I'm now getting the error:~~

Michael SchaufelbergerOP•6/22/24, 11:08 AM

FYI I have since changed the above code a bit, so there's no

id

id

field inside the variable. Since that doesn't make sense.

Michael SchaufelbergerOP•6/22/24, 11:14 AM

Scratch that error above. It seems to be working!

Drizzle push somehow thinks it needs to remove the not nulls after adding the index. Since I wanted to specify notNull() anyways I added that.