#
✕ nick:eiln
#asahi-dev · 2023-01-22 03:59
eilnmeaning most* apple coreml models can be asahified now
#asahi-dev · 2023-01-22 03:59
eilngot chaining to work
#asahi-dev · 2023-01-21 20:22
eilnholy, nice work
#asahi-dev · 2023-01-17 20:37
eilnrough benchmark & progress https://pastebin.com/UGyeNH6T :)
#asahi-dev · 2023-01-17 15:05
eilnyes
#asahi-dev · 2023-01-17 15:04
eiln0.002398727 per batch for inception_v3
#asahi-dev · 2023-01-17 15:03
eilni'm getting a 4x speedup with a capped iova limit
#asahi-dev · 2023-01-17 15:02
eilniovas are a function of access distance
#asahi-dev · 2023-01-17 15:02
eilnholy shit
#asahi-dev · 2023-01-16 12:48
eilnstill relatively shallow networks only though, currently working on chaining buffers
#asahi-dev · 2023-01-16 12:45
eilnno ANE!
#asahi-dev · 2023-01-16 12:42
eiln150x speedup, i'll take that :PP
#asahi-dev · 2023-01-16 12:42
eilnpytorch (cpu) takes 1.61288843667 sec/batch
#asahi-dev · 2023-01-16 12:42
eilnmy very preliminary numbers show 0.010734896 sec/batch for inception_v3
#asahi-dev · 2023-01-14 07:03
eilndoes make me think there could be perf gains w/ dedicated kernels for common routines
#asahi-dev · 2023-01-14 07:02
eilne.g. Hardswish function in MobileNetV3 isn't implemented, so it goes NPU --deswizzle--> CPU Hardswish --reswizzle--> NPU, quadrupling the time from MobileNetV2 which is fully NPU
#asahi-dev · 2023-01-14 07:02
eilnCPU layers are fallback for passes their compiler hasn't implemented yet lol not because it's more efficient or whatever
#asahi-dev · 2023-01-14 07:01
eilnrelated, the coreml "device distribution algorithm" 100% favors NPU
#asahi-dev · 2023-01-14 07:00
eilnthey repetitively emphasize power consumption though, "executing on a device that is orders of magnitude more energy-constrained"
#asahi-dev · 2023-01-14 06:59
eilnthe speed numbers are pretty mediocre, considering they do a repo's worth of surgery on top of their closed-source framework
#asahi-dev · 2023-01-14 06:59
eilnif you look at https://github.com/apple/ml-ane-transformers
#asahi-dev · 2023-01-14 06:19
eilnmarcan: actually DCT/DST transforms seem very doable, let me see if i can some up with a temporary jpeg/scaler block for the meantime ;)
#asahi-dev · 2023-01-14 06:12
eilnfrom what ive seen the selling point is power-efficiency over raw speed
#asahi-dev · 2023-01-14 06:12
eilnchadmed: thank you :)) nice work on audio too
#asahi-dev · 2023-01-14 05:39
eilncolor space conversion seems very feasible too imo
#asahi-dev · 2023-01-14 05:37
eilnhehe
#asahi-dev · 2023-01-14 05:37
eilnthey designed it with cnn's in mind, so it's rlly well fitted for image processing
#asahi-dev · 2023-01-14 05:35
eilnhavent got to benchmark anything yet but i do see it being useful for general linalg passes
#asahi-dev · 2023-01-14 05:31
eilnnow trying to port chaining for fatter ones like detection & segmentation..
#asahi-dev · 2023-01-14 05:31
eilnthank you :))
#asahi-dev · 2023-01-14 05:31
eilnlinux! loaded kernel module on reference distro
#asahi-dev · 2023-01-14 05:29
eilnANE fully
#asahi-dev · 2023-01-14 05:29
eilnasahi :)
#asahi-dev · 2023-01-14 05:28
eilnverified pretty much all mainstream classification models (resnet*, mobilenet, inception, etc.)
#asahi-dev · 2023-01-14 05:28
eilnmost "shallow" layer models (of sane, non-gpt density) seem fine
#asahi-dev · 2023-01-14 05:28
eilnresnet at work :,) https://bashify.io/images/RhEv1P
#asahi-dev · 2023-01-07 14:10
eilnhave you installed asahi yet? going through the boot process is a good place to start imo
#asahi-dev · 2023-01-07 14:07
eilnthemadpro: what do you plan on doing? my macos partition with two installs (base & hypervisor) is only 100gb
#asahi-dev · 2023-01-03 06:37
eilnoke back to work :)
#asahi-dev · 2023-01-03 06:37
eilnconsidering only dma to L2 fails when in the upper range, i think it's a distance issue ("hint" seems right)
#asahi-dev · 2023-01-03 06:36
eilnwhat a self-own, there's a semi-enforced iova upper limit .. "vm-size"
#asahi-dev · 2023-01-01 04:35
eilnengine aic irq wants to go to dart for whatever reason
#asahi-dev · 2023-01-01 04:35
eiln"tethered" bc needs to reboot after every run
#asahi-dev · 2023-01-01 04:35
eiln4200 is half precision for 3 btw ;))
#asahi-dev · 2023-01-01 04:35
eiln"tethered" 1+2 on the ane https://bashify.io/images/n1Xz3i
#asahi-dev · 2023-01-01 04:34
eilnnvm figured it out was a platform resource issue (why does this always happen right after..)
#asahi-dev · 2022-12-31 15:14
eiln새해복 많이 받으세요~
#asahi-dev · 2022-12-31 15:11
eilnalso the clock just rang where i am, happy new years everyone :)
#asahi-dev · 2022-12-31 15:05
eilnaddr is 0x26b810000/0x26b820000 + 0x200 (ttbr offset) if it helps
#asahi-dev · 2022-12-31 15:04
eilnit's such a tiny thing but i'm pretty stuck

plus ›