Xangelix
Explore posts from serversCDCloudflare Developers
•Created by mrparker on 7/11/2023 in #pages-help
Taking advantage of brotli compression
13 replies
CDCloudflare Developers
•Created by mrparker on 7/11/2023 in #pages-help
Taking advantage of brotli compression
...oh nvm
13 replies
CDCloudflare Developers
•Created by mrparker on 7/11/2023 in #pages-help
Taking advantage of brotli compression
https://blog.cloudflare.com/new-standards/
From two hours ago! @Pipoca @mrparker
13 replies
CDCloudflare Developers
•Created by mrparker on 7/11/2023 in #pages-help
Taking advantage of brotli compression
13 replies
CDCloudflare Developers
•Created by mrparker on 7/11/2023 in #pages-help
Taking advantage of brotli compression
@Pipoca @mrparker did you ever find an solution?
it's quite frustrating that the documentation references dashboard pages that do not exist, and the
_headers
file does not respect the cache-control, content-type, content-encoding, OR, and this is the primary reason I am pre-compressing, the content-length header.13 replies
CDCloudflare Developers
•Created by Xangelix on 9/19/2024 in #pages-help
Can I pre-compress a file to provide a Content-Length header?
This appears to work fine-- but provides the file only as
wasm.br
. So I must download an additional dependency to decompress the wasm in my javascript code.
If I instead just name the file myfile.wasm
and set the headers for that instead, it seems to not respect the headers any longer.
I get no Content-Length header and given that I cannot run the wasm download, and I get magic number errors: expected magic word 00 61 73 6d, found cf ff ff 7f @+0
-- it appears to be recompressed on cloudflare's side, and only one layer is decompressed by my browser.2 replies
CDCloudflare Developers
•Created by Xangelix on 9/19/2024 in #general-help
CF Pages: Can I pre-compress a file to provide a Content-Length header?
Oops~! Moving this to #pages-help
2 replies
RRunPod
•Created by Xangelix on 4/11/2024 in #⚡|serverless
Questions on large LLM hosting
this didn't seem to lower it enough, is this message a typo? wouldn't I want to raise GPU_MEMORY_UTILIZATION if i'm getting OOM https://discord.com/channels/912829806415085598/1211740161948524564/1212674202465869864
8 replies
RRunPod
•Created by Xangelix on 4/11/2024 in #⚡|serverless
Questions on large LLM hosting
could this be fixed with
ENFORCE_EAGER=1
?8 replies
RRunPod
•Created by Xangelix on 4/11/2024 in #⚡|serverless
Questions on large LLM hosting
4 an extra one
How much VRAM does VLLM typically use outside of the weights? I'm testing a model now that only uses 38GB in weights, but I'm getting OOM on 48GB gpus...
8 replies