Right now, either maxFilesPerTrigger or maxBytesPerTrigger could be ended read in the middle of a transaction. we have a case that needs to read all data or none for a transaction.

could we add an option to support something like "soft maxFilesPerTrigger"