#asahi-re · 2022-03-28 09:55
marcan(and possibly also a JPEG encoder)#asahi-re · 2022-03-28 09:54
marcanso I would expect it to have a scaler#asahi-re · 2022-03-28 09:54
marcancamera processing these days is magic#asahi-re · 2022-03-28 09:54
marcan_jannau_: could be, but ISP does more complicated stuff than scaling anyway...#asahi-re · 2022-03-28 09:54
marcanI do want to work on that, once the GPU is nice and smooth ;)#asahi-re · 2022-03-28 09:54
_jannau_not sure if the isp includes it's on scaler, i.e. you would use the scaler on the isp output#asahi-re · 2022-03-28 09:54
marcanhasn't exactly been linux's forte ever...#asahi-re · 2022-03-28 09:54
marcandottedmag: yeah but first you need to, like, figure out HDR/color management/etc at the application layer for any of this to be useful#asahi-re · 2022-03-28 09:53
marcanso ISP probably has its own#asahi-re · 2022-03-28 09:53
marcanthe scalers are instantiated by the AP#asahi-re · 2022-03-28 09:53
dottedmagOTOH, unless the capabilities of hardware are known, it's unclear what to expose in Linux.#asahi-re · 2022-03-28 09:53
marcanISP is its own thing#asahi-re · 2022-03-28 09:53
_jannau_I'd guess the seperate scalers are for camera input/isp#asahi-re · 2022-03-28 09:52
marcanso I wouldn't think too hard about that until people first figure out how it should all work on linux anyway#asahi-re · 2022-03-28 09:52
marcanthat all seems like a giant mess though, and Linux support for HDR is kind of a joke still#asahi-re · 2022-03-28 09:52
marcanlike dedicated HDR overlay planes or something#asahi-re · 2022-03-28 09:52
marcanalso I heard that on the Pro/Max, there is even more nonsense for HDR output#asahi-re · 2022-03-28 09:50
marcanit might be mostly for stuff like huge images#asahi-re · 2022-03-28 09:50
marcanAIUI the dedicated scaler blocks are actually useful because they're pretty fast? I don't know what apple uses them for though, but I'm guessing at least video/image scaling? would be nice to find out#asahi-re · 2022-03-28 09:49
rqou_in addition to the dedicated "scaler"#asahi-re · 2022-03-28 09:49
rqou_the jpeg block also has a scaler#asahi-re · 2022-03-28 09:49
marcanall display output hardware has scaling these days...#asahi-re · 2022-03-28 09:49
rqou_lol how many "scaling" blocks does this chip have?#asahi-re · 2022-03-28 09:49
marcanyou can put the video surface below an overlay layer with the rest of the UI#asahi-re · 2022-03-28 09:49
marcanand basic scaling#asahi-re · 2022-03-28 09:49
marcanDCP supports alpha channels, it can composite for you#asahi-re · 2022-03-28 09:48
dottedmagmarcan: how would that work? a special case in compositor if it knows that nothing has to be composited over the surface that shows the video? (presumably any overlay interface element would require GPU to be enabled)#asahi-re · 2022-03-28 09:47
rqou_ooh that's actually really cool#asahi-re · 2022-03-28 09:47
marcanand the reason for this is so that macos can do stuff like play 4K youtube videos in safari with the GPU *off* and the video decoder feeding directly into a DCP surface with minimum memory bandwidth usage#asahi-re · 2022-03-28 09:46
rqou_huh that's interesting#asahi-re · 2022-03-28 09:46
marcanDCP has a whole bunch of that#asahi-re · 2022-03-28 09:46
marcanrqou_: also re compressed formats, at least some of them need additional out of band metadata beyond dimensions/pitch as usual#asahi-re · 2022-03-28 09:44
marcanand around things like keeping decode output in VRAM, which is also not the case here#asahi-re · 2022-03-28 09:44
rqou_yeah, i'm mostly focused on RE/hardware docs and don't actually know much about linux driver dev or upstream#asahi-re · 2022-03-28 09:44
marcane.g. the x86 world of video decoding is centered around GPUs doing it, which is not the case here#asahi-re · 2022-03-28 09:44
marcanalso keep in mind that "the x86 way" is often the wrong way#asahi-re · 2022-03-28 09:43
marcansomething along those lines is probably the way to go, but it needs to be discussed with upstream to make sure what we're doing makes sense#asahi-re · 2022-03-28 09:43
marcanfor video codecs there's different frameworks, stuff like v4l m2m#asahi-re · 2022-03-28 09:42
marcanour goal is to do things right and upstream them, and that isn't upstreamable#asahi-re · 2022-03-28 09:42
marcanleave that nonsense to lazy hardware vendors#asahi-re · 2022-03-28 09:42
marcanwe're shaving all the yaks here, no char/misc devices please#asahi-re · 2022-03-28 09:42
chadmedincluding its fourccs #asahi-re · 2022-03-28 09:42
chadmedhttps://wiki.multimedia.cx/index.php/Apple_ProRes this page has some decent info on the different bitfields in the prores headers and stuff#asahi-re · 2022-03-28 09:42
marcanyeah no#asahi-re · 2022-03-28 09:40
rqou_worse case you can make a char/misc device or something awful like that#asahi-re · 2022-03-28 09:40
rqou_uhh i don't know anything about the linux driver side#asahi-re · 2022-03-28 09:39
chadmedfor it to be useful we'd have to add ProRes 422 support to VAAPI or something right#asahi-re · 2022-03-28 09:31
rqou_has anybody looked at the dart,t8110 yet other than Jamie[m]1?#asahi-re · 2022-03-28 09:29
rqou_(this is all from REing the driver)#asahi-re · 2022-03-28 09:28
rqou_but otherwise you just feed the hardware frames and it gives you data back when it's done