I'm running out of space on my local machine so I've mounted a Google Cloud Storage bucket to my local machine using gcsfuse
. I am now exporting my library from Lightroom Classic as JPEG files to the mounted GCS bucket, but the process is extremely slow, much slower than it should be if one is strictly accounting for encoding speed and time to upload the files to GCS.
I believe what is happening is that Lightroom is incrementally writing the encoded files to the filesystem. This is fine on a normal system, but with gcsfuse
, a file modification includes reading the entire file from GCS, editing the file and writing the entire thing back to GCS. This means that each incremental write is taking orders of magnitudes more time than it would otherwise.
I've come up with a temp solution of exporting 50 files at a time to a local directory and then doing a mass move to the directory that consists of the mounted GCS bucket, but I'd like to make it so that I can export my entire library in one go from Lightroom to the mounted GCS bucket. To do this I need to change Lightroom to only write JPEG files after they've been entirely encoded, is there a way to do this?
ls -l
of the mounted partition it shows the files being slowly increased in size as if they are being written incrementally. I also am able to show that exporting to a local directory and then moving those local files to the network-mounted partition is net faster than just exporting directly to the externally mounted partition. This makes me believe that the files are being written incrementally. \$\endgroup\$