I'm not sure of its performance, but the Pi4 has a hardware video encoder so you could put a CM4 on a HAT connected via a PCIe flexi via some sort of PCIe bridge chip and then the video connector on the Ethernet/USB side of the HAT. That would probably open up a host of other applications (hint to those companies who make and sell HATsI'm not sure that is the case; In this talk they did at the launch of the Pi5 ( https://www.youtube.com/watch?v=vWBNKMf6eQI ), they mention massive throughput of 1.6 billion px/s for the ISP.I suspect the SoC would lag far behind what the interface can provide in data rates. So it would be limited to lower resolution cameras. This interface usually feeds into a dedicated FPGA to do the processing which could be on a HAT above the Pi.
4K120, 8K30 is ~1 billion px/s which is already a huge step from the resolutions / frame rates the current sensors offer.
I'd be even more stoked for a 1st party / Raspberry Pi FPGA HAT type product for high speed signal processing type applications. Even better if it's integrated with the SOC like Xilinx Zynq lineup.
On the other side of that, you do need Encoders ( especially ) in the case of video that can handle this; whis is sadly not present on the Pi5, but I'd love Raspberry Pi to consider coming at that from a similar angle to their AI HAT, producing a HW encoder that connects through PCIE and could handle the encoding work.
)Statistics: Posted by MikeDB — Sun Mar 23, 2025 12:49 pm