Make a spark job cancellable by using a unique jobGroup to send a cancel signal when ZIO is interrupting the fiber.
Make a spark job cancellable by using a unique jobGroup to send a cancel signal when ZIO is interrupting the fiber.
To set the jobGroup correctly when using spark actions, the task if forced to be executed on a standard global scala execution context (scala.concurrent.ExecutionContext.Implicits.global), then call sparkContext.setJobGroup before each statement (for now, until we find a better way)