I'm running out of space on my local machine so I've mounted a Google Cloud Storage bucket to my local machine using
gcsfuse. I am now exporting my library from Lightroom Classic as JPEG files to the mounted GCS bucket, but the process is extremely slow, much slower than it should be if one is strictly accounting for encoding speed and time to upload the files to GCS.
I believe what is happening is that Lightroom is incrementally writing the encoded files to the filesystem. This is fine on a normal system, but with
gcsfuse, a file modification includes reading the entire file from GCS, editing the file and writing the entire thing back to GCS. This means that each incremental write is taking orders of magnitudes more time than it would otherwise.
I've come up with a temp solution of exporting 50 files at a time to a local directory and then doing a mass move to the directory that consists of the mounted GCS bucket, but I'd like to make it so that I can export my entire library in one go from Lightroom to the mounted GCS bucket. To do this I need to change Lightroom to only write JPEG files after they've been entirely encoded, is there a way to do this?