gwenzek
gwenzek
PostsComments
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
Thanks. I find that a bit suprosong behavior from Zig. I would have assume embedFile meant .rodata
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
I think I got it. Zig is putting my model in .data instead of .rodata and the linker script copies the .data to the cart_ram which make sense. Maybe I'm hit by https://github.com/ziglang/zig/issues/18404 ?
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
error: ld.lld: section '.data.cart' will not fit in region 'cart_ram': overflowed by 1500003 bytes
error: ld.lld: section '.data.cart' will not fit in region 'cart_flash': overflowed by 1145093 bytes
error: ld.lld: section '.data.cart' will not fit in region 'cart_ram': overflowed by 1500003 bytes
error: ld.lld: section '.data.cart' will not fit in region 'cart_flash': overflowed by 1145093 bytes
Why is lld trying to copy .data.cart both to cart_ram and cart_flash ? I'd like to have data only in cart_flash
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
crap still 11126 bytes short
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
building in release mode seems to solve the issue. So probably the debug mode doing to aggressive copies
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
thanks, I added some details and only kept the addBias that should only read a small slice of memory.
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
https://github.com/gwenzek/sycl-badge/pull/1
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
The model is already 2-bit quantized, and I do quantized matmul. But for some reason it uses more RAM I would assume. As if the full model was copyed into RAM, vs reading bytes one by one
570 replies
SYCSoftware You Can Love & Zig SHOWTIME
Created by aurame on 5/14/2024 in #sycl24-activities
Day 1 Tables and Badges
Pretty cool stuff. I'm struggling with RAM usage. I've crammed an ML model on the chip but using it for inference seems to copy too much of it into RAM. Any tips ?
570 replies