If you're using a high bit depth, like 16 bits per channel (not pixel), gamma doesn't matter, since it's a reversible transformation.
But, if you're using a limited depth, like 8 bits per channel, then gamma-encoding lets you store around 11 stops of dynamic range in a nominally 8-bit file.