Lancer system & TRL

Let's move the conversation over to a forum post as I have a feeling there could be a few messages. When I'm done w/ lunch I'll finish this initial post. ๐Ÿ˜„
82 Replies
WHITESPINE
WHITESPINEโ€ข2y ago
A small correction - We don't actually use sveltekit. I was mistaken, saw the svelte vite plugin and thought that they were the same thing. Anyways, the project, for context
WHITESPINE
WHITESPINEโ€ข2y ago
GitHub
GitHub - Eranziel/foundryvtt-lancer: A Foundry VTT game system for ...
A Foundry VTT game system for LANCER RPG. . Contribute to Eranziel/foundryvtt-lancer development by creating an account on GitHub.
WHITESPINE
WHITESPINEโ€ข2y ago
(The system's currently mid-rewrite)
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Yeah.. I was going to comment on that.. ;P I've taken a peak at the system repo from time to time to see what is going on.. SvelteKit is definitely cool, but doesn't really have a place in respect to Foundry dev as FVTT dev is all 3rd party client code launched from the Foundry server. I am interest though in svelte-package / part of SvelteKit to see if that will work with component library distribution. https://kit.svelte.dev/docs/packaging When I mention getting TRL to run on & off Foundry running on top of SvelteKit independently is where I'm headed with that; IE TRL providing the final mile / client side desktop app like API.
WHITESPINE
WHITESPINEโ€ข2y ago
Is TRL based on sveltekit? might be a naiive question
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
No.. It's pure Svelte... SvelteKit is more of a way to run a server / routing / SSR for a web app. I'm sure they will be adding authentication soon. TRL is just a plain Svelte component library + other goodies all bundled together to provide a cohesive app dev loop.
WHITESPINE
WHITESPINEโ€ข2y ago
I see Well, sounds like it's irrelevant then :) Our main goal in bringing more svelte into LANCER isn't just to introduce technical complexity for no reason - its that our actor sheets are, quite frankly, ugly. They've grown as we've added more features until they have reached a point that is untenable both from a code and (in our opinion) UX perspective. Component re-use and implementation of click-through workflows are our main goals, but Handlebars as a framework is just frankly not the best tool for the job anymore.
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
For Foundry dev w/ Svelte it's definitely not something I think fits into the picture. I'm certainly glad they are progressing w/ the final release though as a lot of the Svelte maintainers switched to working on SvelteKit and Svelte itself needs a little more love and attention and should be getting some PRs and new support in.. I have a PR for adding container query support that should get in soon.
WHITESPINE
WHITESPINEโ€ข2y ago
that's good. I still don't fully understand container queries, but more tools in the toolbelt are always nice
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
It's good to experience the core API and push it to where it doesn't seem like a good fit. I had this experience w/ fully building out and polishing FQL / Forien's Quest Log. It's about as complex of a module that you'd want to build w/ the core APIs. Heh heh.. I'm going to finish lunch though and BRB for more chat in ~20-30 mins.. ;P
WHITESPINE
WHITESPINEโ€ข2y ago
No rush lol Anyways, our specific goals are initially to replace specific actor/item sheets with svelte/TJS. - Ideally we'd do this in as piecemeal a way as possible - As mentioned, our sheets are very large - Our rough plan is to essentially just convert any handlebars helper into a Svelte component. - We don't use partials much, so this would be a pretty straightforward function -> file conversion. - Ideally, we'd have a fallback mechanism to continue using any non-converted helpers. - This seems trivially accomplished by using {@html whatever} and a fake HelperOptions object reconstructed based on current context. - In this way, we could essentially just convert the entire sheet as a tree top down. It might be overall faster to just do it in one fell swoop, but who knows - Event handlers seem like they would be problematic, as any applyListeners step would likely not survive well under svelte re-generating the DOM. - I don't really know a tidy way around this aspect
Faey
Faeyโ€ข2y ago
regarding authentication: NextAuth.js has recently rebranded as Auth.js and is currently in the process of porting the entire library over to WebStandard API (ditching any and all node deps) and framework agnosticity. In the wake of this, Auth.js Svelte has been released a few months ago I see that LANCER uses Typescript. I couldn't get typescript to work with TRL. I can not find setting that'll let me import @typhonjs-fvtt/runtime/application
WHITESPINE
WHITESPINEโ€ข2y ago
oh right - i forgot this potential stumbling block
Faey
Faeyโ€ข2y ago
There is typedefs for TyphonJS in the NPM package, but I can't for the life of me actually get them to work
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
If there were accurate and up to date Foundry community types that would make it much easier to enable TS declarations for the application sub-module export. IE the one that has SvelteApplication (extends Application). Besides not being up to date the community types are built in a very heavy handed way pulling in all sorts of unnecessary dependencies behind the scene for everything that Foundry exposes. IE if the community types were bundled and had better tooling instead of the kitchen sink approach that is the current arrangement things would be a lot smoother. I just can't tightly couple the community types w/ TRL... What do I do only ship v9 types / hard couple that to a specific release of TRL? Essentially everything else in TRL has types except the meeting point between TRL & Foundry. I built a pretty slick ESM to TS declaration tool that generates bundled types from ESM code / JSDocs.
WHITESPINE
WHITESPINEโ€ข2y ago
So I am far from an expert on this, but to my knowledge Typescript merges all identically named types - meaning you could declare stub types for anything you need, and then just have whatever user-provided vtt types actually "fill out" the body of the interfaces etc. Sort of like how the foundry types themselves populate the source data types
WHITESPINE
WHITESPINEโ€ข2y ago
No description
Faey
Faeyโ€ข2y ago
The problem I am facing is that I can not import the existing available typedef for TRLs own code As such I am unable to import TRL at all in a .ts file A package.json export that has no "types" value and contains only ".js" files appears to be invisible to TSC, at least with the setting options I found Also the heaviness of foundry types is in large parts due to the unfortunate shift in type declaration management that lead to @types being largely abandonned by the community. Typedefs are now found directly in the npm module, forcing fvtt-types to import those modules in their entirety
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
I'm not an expert w/ TS either though do use it from time to time. One of the external libraries that I wrote that is included in TRL was a perfect fit for TS. My general concern is where this can fit on the list of engineering priorities. It's unclear if the Foundry community types are going to survive in the future. v10 not done yet and v11 already here imminently, etc. I'd have to do some engineering analysis on what it would take to get something effectively working for the Foundry bridge part. My general concern is that right now that could be ~1+ month of effort where there are more valuable engineering aspects that have greater impact.
The problem I am facing is that I can not import the existing available typedef for TRLs own code
We'll definitely have to confirm / discuss this separately. TRL does use NPM sub-package exports w/ types defined correctly. You can see in the TRL main distribution that types are defined for all sub-package exports except for the parts that touch Foundry / extend from Foundry classes. https://github.com/typhonjs-fvtt-lib/typhonjs/blob/main/package.json#L49-L57
Typedefs are now found directly in the npm module, forcing fvtt-types to import those modules in their entirety
You can be more clever and bundle types w/ Rollup and other tooling. IE you have them as dev dependencies and a build step in the community types to bundle all of the external packages into a single distributable of just the relevant type declarations.
WHITESPINE
WHITESPINEโ€ข2y ago
luckily the v10->11 change is minimal AFAIK the main problem with the v10 types was that the v9 types weren't full done, and there was a bit of overambition (though who am i to judge) wrt. typing the new Source / System data type split
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Definitely a bit optimistic and too strict approach where. It's more like the community types were a philosophical take on exactness than something that is practical and usable.
Faey
Faeyโ€ข2y ago
They appear to be focusing a lot on type inference sugar instead of prioritizing just getting functioning types out
WHITESPINE
WHITESPINEโ€ข2y ago
at the end of the day, it is a hobby project. I can't blame them overmuch for being drawn to the much more interesting problem of "how do we infer the types on this" versus updating the 3000th change to the FormApplicationOptions interface
Faey
Faeyโ€ข2y ago
In any case, the issue with using TRL in a TS based project, like LANCER, is that I can not find a setting that'll let me import those three submodules
WHITESPINE
WHITESPINEโ€ข2y ago
also it sounds like they've nearly cracked the code
No description
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
The best way forward may be like you suggested to have some sort of facade types that are minimal that are replaced with whatever actual full types / the community types or otherwise. There is not a whole lot of things that need this facade, so if there was a way to not tightly couple any given set of types for the parts that touch Foundry that would be ideal. Hard to say on any code being cracked. The dependency angle / not bundled distribution for the community types IMHO is a hard blocker too. I played around with seeing if I could get bundling of the community types to work, but a lot of esoteric TS foo is applied in the community types that seemingly made that not work out of the box. It would take some time to untangle that aspect.
Faey
Faeyโ€ข2y ago
My expertise of mix-and-match types is a bit limited, but it should theoretically be possible to decalre types in a way that allow a manually imported fvtt-types to complete the typing for you
Faey
Faeyโ€ข2y ago
Yeah funnily enough, TS being TS, Plan C does not work with the clean module import because TSC decides that exports with no corresponding typedef dont exist it'd only work if you directly imported the .js file from the node_modules directory
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
I probably have to add that bare bones declaration as part of the TRL NPM package / define the types field in the sub-package export.
Faey
Faeyโ€ข2y ago
What you could do is import the typedef for Application from fvtt-types and define it as an optional dependency Or rather, not actually import it because it's put into global
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
I believe that optional dependencies are still installed by NPM, but I'd have to verify.
Faey
Faeyโ€ข2y ago
it depends strongly on package manager. optional peerDeps as defined via peerDependenciesMeta should not be installed automatically some npm versions appear to errorneously do it anyway, but that apparently is a bug
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
In general I think the takeaway is that yes, I do want to make TS possible w/ TRL & Foundry. A prior big problem until recently w/ TS was that it didn't work at all w/ NPM sub-package exports and that only got resolved recently. I think TS ~4.8.5 or so; this support got pushed back several major TS versions... It can certainly help to have those that are interested in TS to help test and come up with a game plan.
Faey
Faeyโ€ข2y ago
I'll gladly help out. Although personally i've been looking into replacing TS with JSDoc, TS is still quite nice
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
TRL is mostly JSDoc, but accurate JSDoc unlike some Foundry core aspects. Of interest is my build tool that generates TS declarations from ESM source code: https://github.com/typhonjs-node-build-test/esm-d-ts
Faey
Faeyโ€ข2y ago
I think until we have full TS compatibility, this thread is at its limit though
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
------- Getting back to the main points that you raised earlier:
- Ideally we'd do this in as piecemeal a way as possible - As mentioned, our sheets are very large
There is backward compatible legacy support for Handlebars for Application / FormApplication by HandlebarsApplication & HandlebarsFormApplication. This keeps the App v1 handlebars rendering intact, but gives you the power of the TRL application shell / full reactivity for most things regarding the application shell. https://github.com/typhonjs-fvtt-lib/svelte/tree/main/src/application/legacy More or less it should work by replacing Application / FormApplication w/ the above and no other changes. Indeed each app would need to be piecemeal re-implemented as pure Svelte eventually, but there are initial benefits to the TRL legacy support over stock App v1 API.
- Our rough plan is to essentially just convert any handlebars helper into a Svelte component.
TRL already provides a couple of converted Foundry handlebars helpers. I can add more as necessary: https://github.com/typhonjs-fvtt-lib/svelte/tree/main/src/helper/legacy
- Event handlers seem like they would be problematic, as any applyListeners step would likely not survive well under svelte re-generating the DOM.
- I don't really know a tidy way around this aspect
It's going to be a lot of work, but if done in a piecemeal manner quite possible. I'd certainly like to hear more about the current refactor objectives that you mentioned regarding the current rewrite of LANCER. ------- The next TRL release is focusing on some of the remaining aspects useful for system dev. I already have implemented "reactive embedded collections", but am adding capability to do drag & drop with them the "Svelte way". I'm also buffing up the reactive document wrapper / TJSDocument to provide a mechanism to automatically create stores for individual document properties / auto-update / make it easy to connect document properties to Svelte components transparently without the management overhead. These things should be the last major aspects that really will supercharge Svelte actor / item sheets, etc.
WHITESPINE
WHITESPINEโ€ข2y ago
May well be true, alas. It does sound like there is a path forward if we can get it compiling - in the meantime I'm just going to focus on finalizing this stage of the rewrite (which was a more or less total revamp of our data backend)
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Yeah.. Let's stay in touch. I'm all for finding that pathway for TS packages. If I had to guess ~May would be the approximate time if not sooner that something can get put together. It's a bit hard to schedule / prioritize TS angles w/ the complications from TS itself (no support for subpackage NPM exports until recently), no reliable / solid Foundry TS types and such. Working on actual new features for TRL always edged out finalizing a TS strategy / implementation. I think a rough estimate is that there are less than 10% of packages on Foundry that use TS, so there is that too; a smaller community to serve, etc. ---- So one of the problems that I encountered w/ trying to add types to the application sub-package exports is that in WebStorm this removes intellisense w/ linking the Foundry client code. IE WebStorm seemingly always tries to open up the type declarations and not the linked Foundry source code which is not desirable for the majority working in ESM. I do auto-generate albeit not precise types for these sub-package exports and they are in _types. There may be a way to point to them from tsconfig from the local project, but won't be an immediate solution as the auto-generated types do not include any Foundry API. IE SvelteApplication extending "Application" the auto-generation has no knowledge of the Foundry level. This is where perhaps very minimal definition of Foundry types could come into play. I suppose declaration merging is the thing to look into. https://github.com/typhonjs-fvtt-lib/typhonjs/tree/main/_types/svelte/application And yeah.. It looks like there is no declaration merging for classes, so this likely shoots down any minimal definitions in TRL that could merge w/ say the Foundry community types. https://www.typescriptlang.org/docs/handbook/declaration-merging.html#disallowed-merges posting this in the right place... I put it in the chat lounge: To be fair I didn't update those separated types w/ the latest TRL releases. So they will be old. It was kind of a first attempt to get something running. I don't think it will work well or at all w/ what is currently there and needs some work likely through a combination of auto-generation and by hand. You can checkout: https://github.com/typhonjs-fvtt-lib/svelte - npm install - uncomment these lines for the auto-generation: https://github.com/typhonjs-fvtt-lib/svelte/blob/main/rollupAll.js#L294-L308 - run the NPM build script - copy the _types to your local project ./node_modules/@typhonjs-fvtt/runtime/_types directory In general the problem comes down to it likely taking quite a bit of effort / time to get this working for a handful of folks using TS. Without knowing all the details this could be a massive time sink. What definitely could be helpful is getting folks that need TS support more looped into the process of finding a solution. I know no-one wants to put in any extra time on this... Just a bummer as I fear it could take me ~1+ months just to arrive on a solution when there are other higher priority things to finish off at this time.
WHITESPINE
WHITESPINEโ€ข2y ago
Just a bummer as I fear it could take me ~1+ months just to arrive on a solution when there are other higher priority things to finish off at this time. Completely valid tbh Will try this though
WHITESPINE
WHITESPINEโ€ข2y ago
Took quite a bit to actually update our internal svelte configuration, and have reached a point where importing typhon components seems to be a possibility. Mostly learning my way around how package exports works etc. In particular, seeing issues with types that I copy from local project -> _types not being recognized. I suspect its just because they aren't declared in package.json?
No description
WHITESPINE
WHITESPINEโ€ข2y ago
I edited the @typhonjs-fvtt/runtime package.json to export
"exports": {
//...
"./svelte/application": {
"import": "./_dist/svelte/application/index.js",
"types": "./_types/svelte/application/index.d.mts"
},
}
"exports": {
//...
"./svelte/application": {
"import": "./_dist/svelte/application/index.js",
"types": "./_types/svelte/application/index.d.mts"
},
}
but admittedly I'm just fumbling in the dark ๐Ÿ˜
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Yeah... Not only is what is currently there out of date, but it's not going to work well at all as the JSDocs for that section of code (which the current types are auto-generated from) reference the library linked Foundry code via WebStorm / similar to symlinking foundry.js, so not TS Foundry types. This all works fine and dandy for ESM developers (90%+ of the 3rd party dev community). A further complication last time I tried to link things in package.json is that it messes up the ESM dev experience by jumping to types instead of the source code. Those sub-package exports are not bundled / raw source and intended for folks to be able to click through to the source code and then to the Foundry code if you set up a library in WebStorm. It gives you full intellisense w/ ESM through TRL to the Foundry client code. The previous discussion is finding out some sort of facade / minimal types that are merged with whatever actual Foundry community types or otherwise might be used, but there are likely complications to get both the ESM dev experience top notch at the same time as TS.. That is why I think it is a month+ of effort. It's not just getting TS support, but making sure both the ESM & TS support is top notch.
WHITESPINE
WHITESPINEโ€ข2y ago
Mm yeah fair. FWIW I've been using the v8 foundry types on v11 for a while so I'm fairly used to out of date types, haha. I'd settle for "minimum viable", really - the main things we'd love to have are just access to TJSDocument/related stores. Our current solution to reactivity is fairly crude, and just looks at hook calls to trigger a redraw via a global semaphore-esque store. The way foundry types does global declarations makes me wonder if you'd even need to do an explicit "facade" of types or if it would just resolve more or less naturally
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Also... A good thing to know... TS requires the types field to be the first entry otherwise it doesn't work...
"./svelte/application": {
"types": "./_types/svelte/application/index.d.mts",
"import": "./_dist/svelte/application/index.js"
},
"./svelte/application": {
"types": "./_types/svelte/application/index.d.mts",
"import": "./_dist/svelte/application/index.js"
},
WHITESPINE
WHITESPINEโ€ข2y ago
wait really lmao
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Yeah... It's pretty effed... And not clear at all; not a lot of good resources besides scouring tons of TS issues related to sub-package exports; which I have done during the drawn out implementation for sub-package exports support being added to TS. On a positive front there has been quite a bit of improvements in WebStorm in the past couple of releases for handling types through NPM packages and a lot of other IDE related intellisense issues and is improving every release. I haven't had the time to setup VSCode to test anything. This definitely is one of those final mile to "beta" things to resolve which is an ~end of the year thing more or less or early next year. "beta" is hit when I have TRL running on and off Foundry, so lots more work taking priority before that final stretch for my direct involvement. For the Foundry version of TRL anything that touches / extends Foundry code is just a pain to get working for TS right now from a library construction perspective without official up to date types.
WHITESPINE
WHITESPINEโ€ข2y ago
noddingknight what you gotta do feel like I'm fighting vscode more than typhon at this point, tbh
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Heh heh.. Join the dark side... WebStorm... At least worth trying it out via the OSS license just to give it a spin. Lots of standard dev setup / linking Foundry code / debugging setup w/ TRL / your project code & Foundry client code is rock solid & easy to setup. There are challenges for both IDEs though in respect to the discussion related to Foundry types. I can use help in prototyping what a potential minimal / dummy Foundry types arrangement could look like that is merged w/ say the community types. If that step could be demonstrated / other dev get something minimally functional then that could kick start things. It's just a big context switch for where I'm at w/ the rest of the engineering higher up on the TODO list. At the end of the day... In general because there are no official Foundry types and the future of the community types is in question it's generally reasonable to consider switching to ESM. At least w/ WebStorm everything works great and as long as you write good JSDocs I have had zero problems w/ intellisense or the types of things folks like Typescript for... IE no bugs in all of TRL, but that is just diligent coding. TS does make sense at a larger organization with novice coders in the mix when all the libraries / code has TS types, etc. For the off Foundry aspect of TRL the larger Svelte community will expect full types and that will be easy to provide when Foundry is not in the mix.
WHITESPINE
WHITESPINEโ€ข2y ago
Have been butting my head against this a while. For some reason tsc refuses to acknowledge the import import { SvelteApplication } from "@typhonjs-fvtt/runtime/svelte/application"; Even after interjecting the generated types / fixing package.json "exports" As an experiment, I copied the file @typhonjs-fvtt/svelte-standard/_types/application/index.d.ts to the path @typhonjs-fvtt/runtime/_dist/svelte/application/index.d.ts And then crudely imported from there as follows: import { TJSContextMenu } from "@typhonjs-fvtt/runtime/_dist/svelte/application"; (Essentially, avoided using the "exports" path and routed to it directly) Interestingly, this worked. I then did two sub-experiments: - I attempted import { TJSContextMenu } from "@typhonjs-fvtt/runtime/svelte/application, AKA the "proper" import path. It did not work. - I once more copied the auto-generated _types/application/index.d.mts but this time to _dist/svelte/application/index.d.ts. I then tried a crude import of import { SvelteApplication } from "@typhonjs-fvtt/runtime/_dist/svelte/application";. It did not work. It seems to me that two problems are occurring: - The new generated types seem to not be 100% up to par. Unclear why - For some reason (possibly just a side effect of one or more of the generated types having issue), the "exports" package.json field/paths seems to just not work
WHITESPINE
WHITESPINEโ€ข2y ago
UPDATE: After fixing the following minor syntax errors in the generated code, sub-experiment two (importing SvelteApplication but not via the "exports" path works.
No description
WHITESPINE
WHITESPINEโ€ข2y ago
^ Realizing this isn't particularly helpful, but it was just some small issues where seems it assumed a callback would be generic but then didn't actually follow through.
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
The not using the exports path thing is definitely a TS quirk as technically anything not defined in the "exports" rules of "package.json" should not be allowed. Though that is more a NodeJS runtime aspect. The types currently in @typhonjs-fvtt/runtime/_types are old as mentioned here with general instructions on how to regenerate them though it's not going to be the solution: https://discord.com/channels/737953117999726592/1078418639461560363/1078486893278285866 _types was my initial attempt at getting this working, but clearly is not the way re: auto-generation. If you have the time the two big areas of general types / TS config to research are: 1) Can a minimal shim FVTT types package be put together with just what is required to cleanly do declaration merging with the full community FVTT types. A minimal demo / proof of concept would be great! 2) Is it possible to configure TSC / tsconfig.json to recognize side-loaded types for those sub-package exports without assigning a types field to the export entry in package.json.
----------- The idea is to auto-generate the types from ESM; hand modify them w/ the FVTT types shim, be able to side-load them for a sub-package export and merge w/ the community types. This may be necessary for the ESM / core library linking aspects for IDE discovery w/ Foundry in particular. I'll investigate the best approach given #1 above though as perhaps it is possible to use the types field.
WHITESPINE
WHITESPINEโ€ข2y ago
Right - to be clear, I used those instructions. These are the auto generated types . I'd be more inclined to believe its an issue in esm-d-ts than in typhon, specifically, but it is something to be aware of. What's the rationale behind all of the nested package.json files? Or for application being copied instead of running through the rollupconfig logic? Relevant snippet:
for (const config of rollupConfigs)
{
console.log(`Generating bundle: ${config.input.input}`);

const bundle = await rollup(config.input);
await bundle.write(config.output);

// closes the bundle
await bundle.close();

console.log(`Generating TS Declaration: ${config.input.input}`);

await generateTSDef({
main: config.input.input,
output: upath.changeExt(config.output.file, '.d.ts')
});

fs.writeJSONSync(`${upath.dirname(config.output.file)}/package.json`, {
main: './index.js',
module: './index.js',
type: 'module',
types: './index.d.ts'
});
}

// Handle application & application/legacy by copying the source.
fs.emptyDirSync('./_dist/application');
fs.copySync('./src/application', './_dist/application');

fs.writeJSONSync(`./_dist/application/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});

fs.writeJSONSync(`./_dist/application/dialog/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});

fs.writeJSONSync(`./_dist/application/legacy/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});
for (const config of rollupConfigs)
{
console.log(`Generating bundle: ${config.input.input}`);

const bundle = await rollup(config.input);
await bundle.write(config.output);

// closes the bundle
await bundle.close();

console.log(`Generating TS Declaration: ${config.input.input}`);

await generateTSDef({
main: config.input.input,
output: upath.changeExt(config.output.file, '.d.ts')
});

fs.writeJSONSync(`${upath.dirname(config.output.file)}/package.json`, {
main: './index.js',
module: './index.js',
type: 'module',
types: './index.d.ts'
});
}

// Handle application & application/legacy by copying the source.
fs.emptyDirSync('./_dist/application');
fs.copySync('./src/application', './_dist/application');

fs.writeJSONSync(`./_dist/application/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});

fs.writeJSONSync(`./_dist/application/dialog/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});

fs.writeJSONSync(`./_dist/application/legacy/package.json`, {
main: './index.js',
module: './index.js',
type: 'module'
});
Only usage for multiple package.json that I've ever encountered is mono-repo type setups
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
The copying of the application packages makes it easier to read the code when you click through to it from the IDE rather than one single bundled file. The copying of the component package is so that the .svelte files are compiled for the proper runtime in your project. When you run the dev server you can't use pre-compiled Svelte components as the way automatic Svelte HMR works is by using a proxy SvelteComponent parent during compilation. A fair amount of the other sub-package exports import various libraries together so are bundled themselves to pull in everything. At the end of a production build in your project you of course control the bundling / minification, so there is no reason to necessarily bundle / compress / pre-process TRL and such where not necessary. I will be changing things around for the Svelte components using SvelteKit package later this year. ---- Re: package.json in each dist / sub-package. It should neither hurt / nor hinder anything. I got started on TRL just before sub-package exports. It could be left over from those early days, but the Svelte library also does the same, so um maybe I copied that when running into problems in the early days of sub-package export support. It certainly can be evaluated if necessary and if not removed now that there is more tooling support. esm-d-ts is pretty solid and works well. It does use TSC after all. For the application sub-packages that touch Foundry the actual global references for Foundry API are used in JSDoc. This works for ESM especially well in WebStorm when linking the Foundry client code to your project, but doing this does not produce anything meaningful for Typescript for auto-generation from that JSDoc. That explains why the #1 & #2 "research" steps are being pursued as described.
Auto-generate the declarations for the application sub-package exports, manually hand modify them to add the shim / correct things, then hopefully those declarations can be merged w/ whatever Foundry types are in the end developer downstream project build.
WHITESPINE
WHITESPINEโ€ข2y ago
Any idea why esm-d-ts might be generating a $1 suffix to some symbols?
No description
WHITESPINE
WHITESPINEโ€ข2y ago
(wonder if its a weird versioning thing? without a package-lock, could easily have had some drift)
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
That is Rollup related artifact as the types are bundled. This doesn't occur in the other auto-generated / bundled sub-packages. I haven't re-generated those types since updating a lot the backing tech / switching from Rollup 2 to 3 and such, so something to look into. IE the existing old _types doesn't show this symptom.
WHITESPINE
WHITESPINEโ€ข2y ago
GitHub
Why is $1 appended to external dependencies? ยท Issue #343 ยท rollup/...
I am running into the issue that Rollup (v0.21.1) is appending $1 to external dependencies when creating an IIFE. Here's an example: import * as d3 from 'd3'; class Whatever...
WHITESPINE
WHITESPINEโ€ข2y ago
appears to be this
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
That is a very old issue for a very early version of Rollup. It could be related, but yes it is a naming conflict thing. I recall having to fix something like that before w/ the auto-generation, but it could be a combination of different things causing it now. While useful to correct it won't solve the issue at hand described by #1 / #2 above. You can see the unbundled d.ts files in the ./dts directory that are generated. The last one generated is what remains afterward.
WHITESPINE
WHITESPINEโ€ข2y ago
ah I see A bit unclear from #2 above 2) Is it possible to configure TSC / tsconfig.json to recognize side-loaded types for those sub-package exports without assigning a types field to the export entry in package.json. What do you mean side-loaded types, here?
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Types that can be associated w/ the sub-package export without explicitly defining the "types" field in the export rule. --- This is more to do w/ maintaining the ESM dev experience from the IDE and being able to click directly through to the source code & have the JSDocs w/ the linked Foundry client code all behave correctly. It's possible that this might be fixed up w/ recent versions of WebStorm / better support of sub-package exports. So need to revisit things again.
WHITESPINE
WHITESPINEโ€ข2y ago
Ah, so like an index.js and index.d.ts in the same folder?
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
WebStorm understands the "types" field and defaults to going to the types instead of the ESM source or at least it did back when support for sub-package exports was initially supported. You could be doing ESM coding click on SvelteApplication and it would only take you to the "broken" types w/ no option to view the source instead. Currently, if you click through it goes to the source code then you can click on Application and w/ the Foundry client code linked it jumps to the Foundry client code. The reason to look into #1 though is that it should be possible to create a standalone proof of concept shim to merge w/ the community Foundry types even if it was for just a single Foundry API class say Application. I'll look into the $1 thing this upcoming week though.
WHITESPINE
WHITESPINEโ€ข2y ago
Thank you
Faey
Faeyโ€ข2y ago
Exported Types never allow click-through to the JS source code, you always get sent to the dts because that's where the typedefs live so that is what is imported in the .ts file. tsc just recognizes the .js file that contains the source and changes the import to that file in the ts-to-js compile step Also, just cuz I didn't see it mentioned anywhere in here @whitespine did you set the module option in tsconfig to nodenext or node16? Otherwise Typescript won't recognize the pacakge.json exports
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
This is highly undesirable for ESM developers; especially when not being able to click through to the Foundry linked client code.
Faey
Faeyโ€ข2y ago
That is not just something ESM developers have to deal with. Anything not explicitly written in typescript is dealt with this way. Unless the IDE writes a special case resolver where you can, with some other key-combination, go to the implementation instead of the declaration TypeScript is also vastly different conceptually from ESM because each .ts file in itself is it's own fully contained module
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
not sure about the above statement. ESM / a file is a module. ๐Ÿ˜„ but semantics.
Faey
Faeyโ€ข2y ago
What I mean is the import syntax typescript files are imported as modules, not files you import file instead of file.ts Which causes... annoying ambiguities A single .ts file is, to the typescript compiler, an external module that contains it's declarations and implementation and exports a module with the same name as the .ts file But if you now have a folder, that contains an index.ts, you can import that folder as a module, with what ever exports are declared in that index.ts and with the name of the folder Importing a single file and a folder looks fully identical
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
Can do the same thing in ESM when using a bundler.
Faey
Faeyโ€ข2y ago
Yea, no bundler though for TS This imo isn't an advantage btw Because this difference in approach creates interop issues
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
What is TSC other than a bundler by another name.. ;P
Faey
Faeyโ€ข2y ago
a mess In any case, the issue with the import not being recognized might be due to a missing/unsupported value in the module field in tsconfig.json it has to be nodenext or node16 node will not resolve these
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
That is correct.
Faey
Faeyโ€ข2y ago
ironically, this is only relevant for the IDE Well, if using vite that is Because vite uses esbuild and esbuild compiles typescript in individual module mode Individual module mode does not resolve external modules at all and just assumes the imports are valid
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
esbuild is used for the dev server / Rollup for the production build.
Faey
Faeyโ€ข2y ago
vite still uses esbuild for typescript compilation iirc regardless of mode in any case, ts is always compiled in that mode by vite Which means it'll compile just fine, even if there is import errors in the IDE So you COULD just ignore them
WHITESPINE
WHITESPINEโ€ข2y ago
Oh, I didn't realize that was mandatory. I tried it but got hundreds of errors so bailed (even after fixing import names to all have .js, which seems like a silly requirement) Will give it a shot
TyphonJS (Michael)
TyphonJS (Michael)OPโ€ข2y ago
even after fixing import names to all have .js
Yeah that is a pain; definitely a bit to read up on latest TS setup for sub-package exports and more... Step #1 above seems like the best thing to get going. The current auto-generation is not going to cut it without a manual step of correcting it / adding a shim for Foundry API for declaration merging, etc.
Want results from more Discord servers?
Add your server