pearcy
Explore posts from serversCCConvex Community
•Created by pearcy on 12/27/2024 in #support-community
Airbyte Convex Destination Connector - 404 Error
Hi, I'm trying to import a json file into Convex via the Airbyte integration
Steps to Reproduce:
1. Set up the Convex destination connector in Airbyte.
2. Entered the Convex deployment URL from my Dev account:
-- deployment_url
3. Entered the correct API key:
-- access_key
4. Clicked "Test the destination"
5. Received the following error.
Configuration check failed
An exception occurred: <Response [404]>
I have tried this a few different times and have gotten the same result. Any help would be greatly appreciated.
7 replies
CCConvex Community
•Created by pearcy on 12/27/2024 in #support-community
External Data Import to Convex with Dagster
I'm encountering issues when using the Convex Streaming Import API (/api/streaming_import/import_airbyte_records) to import data with relationships. I'm using Dagster to orchestrate the process, and I'm not using Airbyte directly.
Specifically, I am trying to upsert records into four tables, tools, articleTools, materials, and articleMaterials tables with one json file.
1. Initial Setup:
I'm using Dagster to manage the data import.
I'm directly calling the Convex Streaming Import API from a Python client.
I have a Convex schema with tables for articles, tools, articleTools, materials, and articleMaterials. The relationships are handled through the articleId on articleTools, and articleMaterials tables.
I have a function for creating an article first which works correctly.
2. Problem:
I successfully upload the base article record.
I'm getting errors when importing tools and materials with their relationships to articles.
The errors I've encountered have evolved during debugging but the latest error is IndexNotFoundError: Index tools._by_airbyte_primary_key not found.
3. Debugging Attempts:
Initially, I was receiving "code":"MissingStream" errors and I resolved this by providing table schemas in the payload.
I then received BadJsonBody errors, and those were resolved by:
- Ensuring primaryKey is an array of strings.
- Adding a jsonSchema with properties to correctly define the types of the fields.
- Ensuring primaryKey in the schema is also defined as a list.
- Finally ensuring primaryKey is an array of arrays.
After all these fixes, I'm back to getting IndexNotFoundError: Index tools._by_airbyte_primary_key not found.
10 replies
WWasp
•Created by pearcy on 1/11/2024 in #🙋questions
Unable to access the Dashboard as an admin user
When I spin up a open-saas repo (https://github.com/wasp-lang/open-saas.git) everything works swimmingly except I am unable to access to the Dashboard as an admin user.
-- running locally, Docker Postgres, dev
env changes:
// app/.env.server
[email protected]
// app/main.wasp
isAdmin Boolean @default(true)
Expected behavior:
After these env changes, I signup and should have access to the Dashboard.
-- there is nothing in my account in nav so enter /admin directly in the URL.
If I change all the values to "false", I can get access to the Dashboard but when I go back to account or demo-app it routes me to the login screen.
// app/main.wasp
```
route AdminRoute { path: "/admin", to: DashboardPage }
page DashboardPage {
authRequired: false,
component: import Dashboard from "@client/admin/pages/DashboardPage"
}11 replies