maintenance_tasks
maintenance_tasks copied to clipboard
Shopify
A Rails engine for queueing and managing data migrations.
> Maybe we could pass the cursor to the task data, and it would build the RunsPage, that way we would load the active runs, load the paginated completed runs,...
At the bottom of `MaintenanceTasks::TasksController#show` we call `@runs_page.last?` which causes an additional query which we could easily get rid of by loading one-too-many record per page.
We added an alias in #667 but we should change that name since the concept is no longer "last run" and "previous run" but instead "active runs" and "completed runs"...
Right now to start a run we use a peculiar route: ``` run_task PUT /tasks/:id/run maintenance_tasks/tasks#run ``` As part of 2.0, let's move it to the RunsController as `runs#create`, along...
We wanted to add a way for developers to define a CSV template when using the csv maintenance task. Co-authored-by: @keoghpe TODOs: - [ ] Add tests - [ ]...
I have a task working when running rspec tests, but when testing locally I get the error in the title, more stacktrace below: ``` [ActiveJob] [MaintenanceTasks::TaskJob] [305b1d88-2ba5-4abb-a602-3bc742d7592d] Error performing MaintenanceTasks::TaskJob...
We've moved `main` to prepare a future v2.0.0, mainly by removing deprecated code. One thing we hadn't tackled in order to preserve compatibility is implicit `count` method for tasks. If...
As I turn on the eager loader and start the rails console I receive this error: ``` be rails c 7s arm64 2.7.3p183 /Users/orbanbotond/.frum/versions/2.7.3/lib/ruby/gems/2.7.0/gems/maintenance_tasks-1.10.1/app/models/maintenance_tasks/batch_csv_collection_builder.rb:9:in `': uninitialized constant MaintenanceTasks::CsvCollectionBuilder Did you...
If the gem is processing a CSV task, it currently downloads the entire file into memory in the job: https://github.com/Shopify/maintenance_tasks/blob/e62fa637c8912fa8f962aecc691aeb3d82d4ac82/app/jobs/concerns/maintenance_tasks/task_job_concern.rb#L105-L110 This uses a ton of memory for large files and...
Over at https://github.com/shopify/flow we have been trying to adopt the maintenance task framework and have enjoyed the benefits for our small data migrations, but our main hangup is the loong...
