data engineering
2 published articles
Open Source4 min read
Stream processing · FLIP-21
Apache Flink wants to stop copying data at every operator. That's the easy part
FLIP-21 would let Apache Flink stop copying data between every chained operator, replacing a long-standing safety default with three selectable modes. DEFAULT, COPY_PER_OPERATOR, and FULL_REUSE split the difference between speed and caution. The migration question is still open.
2026-09-14
Hardware & ElectronicsFeatured4 min read
Data Engineering
JPEG at quality 92: the boring data engineering choice that made Photoroom's 7B model work
Photoroom releases the fourth part of its PRX model development series, detailing a data pipeline that prioritizes breadth and consistency over per-image perfection. The post reveals that JPEG compression at quality 92 is indistinguishable from PNG for training, and that the fastest captioner won over the most accurate one when scaling to hundreds of millions of images.
2026-07-06