-
Fujifilm's Compressed Raw Files, Read Without a Converter
ShootFlow now reads Fujifilm's lossless compressed RAFs itself. On five real bodies, X-T2 to GFX 50S, all 159.5 million sensor values match LibRaw's.
-
Fujifilm's Lossy Raw Files Hold a Bit Budget
ShootFlow now reads Fujifilm's lossy RAFs, every value equal to LibRaw's. Both test files use 4.75 bits per sensel: the size is fixed, the step floats.
-
Reading Lumix raw files from the GH5 to the S5, and the white point we got wrong first
ShootFlow now reads the RW2 layouts Lumix bodies have used since 2017: on 12 real cameras, all 331.7 million sensor values match LibRaw's.
-
The same demosaic, bit for bit, five times faster
ShootFlow's directional Bayer demosaic now runs in C: equal to the numpy version bit for bit on five real raw files, 4.2-4.9x faster, 0.44 s for 24 MP.
-
Fujifilm X-Trans demosaic in C, and why numpy's x ** 4 differs between machines
ShootFlow's X-Trans demosaic now runs in C, equal to numpy bit for bit on two real Fujifilm frames and 4x faster. Matching it meant replacing a float32 power.
-
Every Sony Raw File Carries Its Own Lens Correction. Now ShootFlow Uses It.
Sony E-mount ARWs store the lens's distortion and fringe curves. Checked against lensfun on three real frames: within 9 px on 84-411 px corrections.
-
The columns a Nikon stores that aren't picture, found without a camera table
Five of seven Nikon bodies store masked and padding columns at the right edge. A rule read from the sensels matches LibRaw's model table on all seven.
-
Looking for one rare Nikon format detail turned up a bug that made 12-bit NEFs develop nearly black
We probed 235 public Nikon raw files for a rare split row. The split rows decoded right, but three other faults showed up, one of them in every 12-bit NEF.
-
Our X-Trans demosaic chose a direction no better than averaging. Fixing that nearly caught LibRaw
The direction choice in our X-Trans demosaic did nothing on a real frame. A smoothness blend and a clamp bring it within 0.5-0.7 dB of LibRaw.
-
A directional demosaic for Fujifilm X-Trans, scored against known truth
ShootFlow now demosaics Fujifilm X-Trans directionally: 1.8 to 13 dB nearer known truth than bilinear, still 2 to 6 dB behind LibRaw's three-pass method.
-
Finding a lens the camera didn't name
Old Canon raws often name no lens. Their maker note still gives the focal range and aperture, and that alone picks one lensfun lens 38% of the time.
-
A Lumix raw names its lens in the preview
Panasonic RW2 files name no lens in their own EXIF; the embedded JPEG's maker note does. Reading it lets ShootFlow correct real Lumix frames with no flag.
-
A Pentax lens is a number
Pentax files name no lens, only the number the lens reports. ShootFlow now reads it, checked against ExifTool, and remembers the lens you name once.
-
A raw decoder path no camera we have takes: point-transform scans move to C
ShootFlow's DNG reader sent lossless-JPEG scans with a point transform down a slow Python path. Now they decode in C, up to 54x faster, same samples.
-
Four numbers that name a lens: LensSpecification, Nikon's maker note and lensfun
When a raw file names no lens, its focal range and f-numbers at both ends pick one lensfun lens half the time. ShootFlow now uses them for any maker.
-
Fujifilm X-Trans raw files, without the converter
ShootFlow now develops Fujifilm RAF files itself, X-Trans included. Every sensel matches LibRaw on three bodies; the colour layout is stored backwards.
-
Lensfun's 16-bit vignetting draws stripes every four pixels
We ran lensfun 0.3.4's float and 16-bit vignetting code through ctypes. Its 16-bit SSE2 loop draws 4-pixel stripes and breaks each row's end.
-
Olympus raw files, without the converter
ShootFlow now develops Olympus and OM System ORF files itself. On 18 real bodies, from a 2002 compact to the OM-1, every sensel matches LibRaw.
-
Panasonic raw files, read from the top down
ShootFlow now develops Panasonic Lumix RW2 files itself. On four real bodies, GF1 to GF7, all 50 million stored sensels match LibRaw.
-
Pentax raw files, and where the camera really crops
ShootFlow now reads Pentax PEF files itself: all 36.6 million sensels of a K-1 Mark II frame match LibRaw, and the camera's JPEG is not centred.
-
Reading Nikon Raw Files Without a Converter: 130 Million Sensor Values, All Matching LibRaw
ShootFlow now reads Nikon NEF files directly. On seven real bodies, D70 to D810, every one of 130.6 million sensor values matched LibRaw, in 0.1-0.6 s per file.
-
Samsung raw files, and a filter tag that lies
ShootFlow now develops Samsung NX SRW files itself: all 90 million sensels on four bodies match LibRaw, and two files get their own filter layout wrong.
-
Sony raw files, without the converter
ShootFlow now develops Sony ARW files itself: compressed, uncompressed and lossless. On six real bodies every sensel matches LibRaw.
-
Sony writes its lens names in hex
Three of ten real Sony and Samsung raw files name no lens in EXIF. Their maker notes do, and reading them settles three more range ties too.
-
The last single-threaded step in a raw develop
ShootFlow's DNG developer threaded everything but its first step, turning sensor counts into light. Banding it made it 5x faster, same bytes.
-
The lens an Olympus file hides
Olympus bodies from the E-1 to the first PENs write no standard lens tag, but their maker note names the lens. Reading it identified eight real frames.
-
The maker note a DNG keeps
Adobe DNG Converter moves the camera's maker note into a private block. ShootFlow now reads it there, checked against ExifTool on a real Canon DNG.
-
A darker corner in five terms: lensfun's vignetting as a DNG opcode
ShootFlow now brightens dark lens corners from lensfun's calibrations, fitted to a DNG opcode: median error 0.0036% over 54,108 cases.
-
A phone's raw file, sensel for sensel, and a corner check that was looking the wrong way
A Google Pixel 3 XL lossless-JPEG DNG matches LibRaw on all 12.2 million sensels, its tiles decode on every core, and a rotated preview fooled a check.
-
A sharper lens warp at no extra cost: where the cubic kernel's time went
A lens warp that was 2.2x slower than bilinear now costs less, with identical output: padded planes, shifted-view taps and threaded bands.
-
A volunteer lens profile against the maker's own correction
ShootFlow now corrects lens distortion from lensfun's open database. On a Leica X Vario, lensfun and Leica's own correction differ by up to 8 px.
-
Checking a port against the real library found a bug in the library
ShootFlow's lensfun port matches liblensfun 0.3.4 to 0.008 px. Lensfun's SSE code gives 6 of every 8 coordinates a neighbouring pixel's correction.
-
Lens correction for a whole shoot: one folder, and a note beside every master
ShootFlow's overnight grade stage now corrects every CR2 and DNG for its lens from a folder of lensfun profiles, and notes which lens it used.
-
One sentence in the DNG spec settled three raw-file opcodes, and left three open
ShootFlow runs MapTable and row and column gains on DNG stored raw values: the spec's integer range for OpcodeList1 decides how.
-
Sixteen pixels instead of four: what bilinear sampling costs a lens correction
On a Leica T frame, bilinear sampling in the lens warp threw away 27% of the fine detail. A Catmull-Rom cubic keeps all but 11%, at about twice the cost.
-
The colour fringe fits in fifteen terms
ShootFlow now corrects lateral colour from lensfun with distortion, exactly, as one DNG warp. Uncorrected, 30% of lens profiles leave a 1 px fringe.
-
The failed import that cost more than the copy: placing raw tiles on every core
Placing tiles on the decode threads made a Pixel 3 XL raw read 1.3-1.4x faster with numpy. Without numpy, a retried failed import made it slower.
-
The DNG flag that means 'skip it if you're in a hurry', not 'skip it'
ShootFlow skipped every DNG opcode flagged for full quality only, which is the opposite of what the spec asks. Fixed, and checked on six real camera DNGs.
-
The half that was eight percent: making a phone's raw file read twice as fast
A note blamed Python de-stuffing for half of a DNG tile's decode. A timer said 8%. Moving the whole tile into C made reads 2x faster, same sensels.
-
The RAW file read was the slow part: 4 seconds of bit unpacking, and a develop on every core
Threading a numpy RAW develop halved it on four cores, but the bigger cost was the file read: a per-sample Python loop, now 17x faster, same bytes.
-
Two versions of lensfun brighten the same corner differently
ShootFlow's lensfun vignetting port matches liblensfun 0.3.4. Lensfun's release and master still differ by up to 10% on steep lenses.
-
A sine wave was the slowest thing in the test
The slowest photo-editing test spent 1.4 s encoding 46 seconds of a tone nobody listened to. A 1 s track made it 21% faster.
-
Tungsten, daylight and the tube light in between: reading DNG 1.6's third colour matrix
DNG 1.6 profiles can carry a third camera matrix for fluorescent or LED light. ShootFlow now blends all three; test-scene error falls from 0.079 to 0.0005.
-
Developing a Canon CR2 without DNG Converter: what the file doesn't tell you
ShootFlow now develops Canon CR2 files directly. Four facts a DNG states and a CR2 hides, how we find them, and how close the render comes to LibRaw.
-
Five Canon bodies, two surprises: a neutral white balance and a clip that isn't at the top
ShootFlow's CR2 reader on four more real Canon bodies: one file refused, one with pink highlights, and how each file supplied its own fix.
-
Four even terms are not enough for one lens in six
ShootFlow now runs the DNG 1.6 WarpRectilinear2 opcode. On lensfun's 5,440 real lens profiles, the older opcode can't get within a pixel on about 17% of them.
-
Grouping 10,000 burst frames took 34 seconds; a pigeonhole index makes it 0.4
ShootFlow compared every pair of photo hashes to group burst frames. Splitting the 64-bit hash into 9 blocks finds the same groups 78x faster on 10,000 photos.
-
ShootFlow's overnight pipeline now develops Canon CR2, picking the right profile per camera
Put your camera's .dcp profiles in a folder and ShootFlow's overnight pipeline turns CR2 files into 16-bit masters, refusing rather than guessing a profile.
-
The tone curve 68 camera profiles share is Adobe's default, and 20 numbers redraw it
68 of RawTherapee's camera profiles embed one 8,192-point tone curve. It is Adobe's ACR3 default. A 20-knot spline fit gets within 0.08 of an 8-bit step.
-
The dead sensel and its four diagonals: repairing a DNG's bad pixels before the demosaic
ShootFlow's DNG developer now runs the two bad-pixel opcodes. A dead sensel becomes the mean of its nearest same-colour neighbours, exact on a plane.