zthomas
TTCTheo's Typesafe Cult
•Created by zthomas on 3/8/2023 in #questions
data pipeline for custom user analytics dashboards
I have a project with user generated content and would like to be able to provide personalized analytics dashboards to each user. I am using mixpanel (but open to switch providers) to log analytics events like page views and engagements. I am also using T3/Vercel/Planetscale.
I am curious if anyone has experience or guidance building out a feature like this. I can query mixpanel's APIs for the data I need to build these dashboards, but because of the rate limits it does not make sense to do this on-demand in an api route.
- Should I schedule a cron to export/parse the data and write the reports I need to my primary database?
- At what scale does it make sense to export to something like a data warehouse? (https://aws.amazon.com/redshift/)
Thanks for any insights
6 replies