see also #5556 Right now it's either aggregate whole chunks or 1D arrays, maybe should allow frame-by-frame