Sebastian Krzyszkowiak @dos@librem.one

@pavel @datenwolf @dcz @martijnbraam @NekoCWD I played with it over the last days and I already have 526x390 30 FPS encoding with live viewfinder, perfectly synced audio, color correction, lens shading correction, tone mapping, AWB and AE - consuming about 40% CPU. Still needs chromatic shading correction and AF, and I started experimenting with enabling PDAF.

I can also make the sensor output 60 FPS and RAW10. Patches incoming ;) Still only 2 MIPI lanes though, so no 13MP 30FPS yet.

@asegPL Żeby jakikolwiek system się dało tak zainstalować przy EFI, musiałby siedzieć na FAT32.

@1peter10 @agx @postmarketOS @yoasif @phosh I mean, I'm not exactly a social butterfly and we had a pandemic meanwhile, but "ooh it doesn't need swipes, I hate those on my phone" was still something I heard surprising number of times when I showed my phone to people in those early days 😂 I honestly didn't expect these reactions.

@1peter10 @agx @postmarketOS @yoasif @phosh I've seen many people praise the early Phosh interface for everything being an obvious tap away and that there's no need for performing swipes to use it. At the same time lots of people (perhaps more) complained that they couldn't swipe 🫩
Swipes solve some issues and we're in much better place now than we were without them, but I think it may be worth contemplating on how to bring back the possibility of swipeless operation, even if behind an a11y flag

@cas @ireneista When it comes to L5, touchscreen in u-boot is just a motivated hacker away. Touch and panel are very easy to drive, and there's a working display controller driver for imx8mq Reform out there already, so it's mostly about connecting the pieces together.

uint8x16_t vector1 = ((uint8x16_t){1} > (uint8x16_t){0}) >> 7;
printf("%d\n", vector1[0]); // 1 in clang, 255 in gcc

uint8x16_t vector2 = (uint8x16_t){1} > (uint8x16_t){0};
vector2 = vector2 >> 7;
printf("%d\n", vector2[0]); // 1 in both gcc and clang

🤔

Aren't you glad that sfghefaes (@dawlkjr27898) has added you to a group conversation on Twitter?

@pavel Passing the right buffer size to gst_dmabuf_allocator_alloc helps it to not crash and not have garbage at the end of the frame 😂

@pavel For GTK: either https://docs.gtk.org/gdk4/class.DmabufTextureBuilder.html or https://gstreamer.freedesktop.org/documentation/gtk4/index.html

For SDL with GL: just import it the same way V4L buffers are imported.

Frankly, it's flexible enough that your choice of toolkit should only depend on other factors.

@pavel That one line is the only thing that runs from another thread and it's neither scary nor requires any locking 😁

But there are several other smelly things in this code and lots of missing error handling, so I'd rather start with that when looking for suspects.

@pavel Not sure what you mean. GStreamer is internally multi-threaded, but its API is thread-safe and there's only one thread in this code. Of course any kind of production-quality code will use some mainloop and enqueue buffers based on callbacks rather than while(!processed){} loop, but it's not exactly rocket science.

@pavel You've got a dma-buf handle, already mapped buffer and even GStreamer with all its sinks available, so... however you want? Pretty much anything will be able to consume it easily.

@pavel I'm playing with GStreamer now (which is new for me) and it seems like most of this code could be replaced with GStreamer elements, and the rest should neatly plug in as custom elements 😂

@pavel Yes, of course.

BTW. Turns out that streaming to YouTube instead of a local file is just a matter of using rtmpsink instead of filesink 😁

@pavel Pretty sure it will just work fine once it's rewritten cleanly and does such arcane magic as releasing the buffers at the right time etc. :)

@pavel When I lie to GStreamer and tell it that its input is in YUY2, it gets faster - perhaps even fast enough to encode at 1052x780. That's another opportunity for improvement.

(and there's nothing magic about fences, it's just a simple synchronization primitive 😛)

@pavel Toggling the killswitch makes it appear though.

IIRC PDAF was also usable at half-res.

RAW10 is just a matter of setting up clocks for higher bandwidth and more lanes. Switching data format is then just a single register away.

@pavel There's a question whether it will be worth elevated power consumption though. I've also stumbled upon csi erroring out with "Rx fifo overflow" requiring a reboot to recover that I haven't seen at lower resolutions, but haven't looked closer.

@pavel LDLIBS = -lEGL -lGLESv2 -lm -ldrm -I/usr/include/libdrm -lgbm -lgstvideo-1.0 -lgstapp-1.0 -lgstallocators-1.0 -lgstreamer-1.0 -lgobject-2.0 -lglib-2.0 -I/usr/include/gstreamer-1.0 -I/usr/include/glib-2.0 -I/usr/lib/aarch64-linux-gnu/glib-2.0/include