spring-projects
Getting error with Springboot 3.4.1 while executing batch jobs
Bug description Getting error with Springboot 3.4.1 while executing batch jobs
Error Message: Command failed with error 251 (NoSuchTransaction): 'Transaction with { txnNumber: 24 } has been aborted.' on server pl-0-eu-west-1.3dhx9.mongodb.net:1041. The full response is {"errorLabels": ["TransientTransactionError"], "ok": 0.0, "errmsg": "Transaction with { txnNumber: 24 } has been aborted.", "code": 251, "codeName": "NoSuchTransaction", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1735790456, "i": 1}}, "signature": {"hash": {"$binary": {"base64": "sKYXYVX+BZTVEOMUocGi7Cm8t2A=", "subType": "00"}}, "keyId": 7434572047025438725}}, "operationTime": {"$timestamp": {"t": 1735790456, "i": 1}}}
Possible Cause: The error might be due to the transaction timeout or multiple write operations causing the transaction to abort.
Environment
- Spring Batch version: 5.2.0
- Java version: 21
- Database: Mongo Atlas
Steps to reproduce
- Execute the batch job.
- The job should sync all data.
- The job aborts in between, possibly due to multiple write operations.
Expected behavior The batch job should execute and sync all data without aborting.
Minimal Complete Reproducible example Fails at: mongoTemplate.findAndModify(query, update, SelectorModel.class, CollectionNames.SELECTORS);
Thank you for opening this issue. However, this is not enough for us to reproduce it. Please upload the code to run to reproduce the error. You can start with this project template. We also have docker-based integration test for MongoDB that you can use to provide a failing test.
Thank you upfront.
Hi @fmbenhassine I'm having a similar issue with findAndModify on BATCH_SEQUENCES:
Exception message: Command failed with error 112 (WriteConflict): 'Caused by :: Write conflict during plan execution, and yielding is disabled. :: Please retry your operation or multi-document transaction.'. The full response is {"errorLabels": ["TransientTransactionError"], "ok": 0.0, "errmsg": "Caused by :: Write conflict during plan execution, and yielding is disabled. :: Please retry your operation or multi-document transaction.", "code": 112, "codeName": "WriteConflict", "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1741091658, "i": 90}}, "signature": {"hash": {"$binary": {"base64": "syQVyb57PxBWu3BfpYK5ciTQodU=", "subType": "00"}}, "keyId": 7433756372606386178}}, "operationTime": {"$timestamp": {"t": 1741091658, "i": 90}}}
My job launcher configuration:
@Override
@Bean
public JobLauncher jobLauncher(JobRepository jobRepository) {
var jobLauncher = new TaskExecutorJobLauncher();
jobLauncher.setJobRepository(jobRepository);
jobLauncher.setTaskExecutor(new VirtualThreadTaskExecutor("spring-batch-"));
return jobLauncher;
}
My job repository configuration:
--> MongoConfig.java
@Bean
public MongoTransactionManager transactionManager() {
return new MongoTransactionManager(mongoDbFactory());
}
--> BatchConfig.java
@Bean
public JobRepository jobRepository(MongoTemplate mongoTemplate,
MongoTransactionManager transactionManager) throws Exception {
var jobRepositoryFactoryBean = new MongoJobRepositoryFactoryBean();
jobRepositoryFactoryBean.setMongoOperations(mongoTemplate);
jobRepositoryFactoryBean.setTransactionManager(transactionManager);
jobRepositoryFactoryBean.afterPropertiesSet();
return jobRepositoryFactoryBean.getObject();
}
The jobLauncher will be called through an HTTP endpoint and will run a simple job (read an http flux and save elements in mongo). If I spam the HTTP call, I get this error.
StackTrace:
[com.mongodb.internal.connection.ProtocolHelper, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.InternalStreamConnection, com.mongodb.internal.connection.UsageTrackingInternalConnection, com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection, com.mongodb.internal.connection.CommandProtocolImpl, com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServerConnection, com.mongodb.internal.connection.DefaultServer$OperationCountTrackingConnection, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.async.function.RetryingSyncSupplier, com.mongodb.internal.operation.SyncOperationHelper, com.mongodb.internal.operation.BaseFindAndModifyOperation, com.mongodb.client.internal.MongoClusterImpl$OperationExecutorImpl, com.mongodb.client.internal.MongoCollectionImpl, com.mongodb.client.internal.MongoCollectionImpl, jdk.internal.reflect.DirectMethodHandleAccessor, java.lang.reflect.Method, org.springframework.util.ReflectionUtils, org.springframework.data.mongodb.SessionAwareMethodInterceptor, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.JdkDynamicAopProxy, jdk.proxy3.$Proxy213, org.springframework.batch.core.repository.dao.MongoSequenceIncrementer, org.springframework.data.mongodb.core.MongoTemplate, org.springframework.batch.core.repository.dao.MongoSequenceIncrementer, org.springframework.batch.core.repository.dao.MongoStepExecutionDao, org.springframework.batch.core.repository.support.SimpleJobRepository, jdk.internal.reflect.DirectMethodHandleAccessor, java.lang.reflect.Method, org.springframework.aop.support.AopUtils, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.transaction.interceptor.TransactionAspectSupport, org.springframework.transaction.interceptor.TransactionInterceptor, org.springframework.aop.framework.ReflectiveMethodInvocation, org.springframework.aop.framework.JdkDynamicAopProxy, jdk.proxy3.$Proxy171, org.springframework.batch.core.job.SimpleStepHandler, org.springframework.batch.core.job.AbstractJob, org.springframework.batch.core.job.SimpleJob, org.springframework.batch.core.job.AbstractJob, org.springframework.batch.core.launch.support.TaskExecutorJobLauncher$1, java.lang.VirtualThread]
