Francisco Dorado

I am a software developer focused on back-end and specialized in Java and Spring.


Hits

Spring Batch AWS Series (I): Introduction

(Reading time: ~1 min)
29 Jul 2019 » spring

Steps

This entry is the first in a series of posts about how to process different steps in Spring Batch remotely. In this project we are going to use Amazon SQS as communication channel between the remote processes.

Introduction

Spring Batch is a processing framework designed for robust execution of jobs. Each job is divided in steps and each step could be executed in a remote way using slaves. There are differents strategies to do this:

The project

The goal of this project is create a Job with diferent steps and each one will implement a different remote strategy.

  • Step1: Using Remote Chunking
  • Step2: Using Partitioning with pooling

We are going to divide in two projects:

  • The master project that will be in charge of orchestrating the Job and sending the tasks to the slaves.
  • The slaves will do the work and will report the result to master.

References

[1] Spring Batch Framework Github