Package: maestro 1.4.0

maestro: Orchestration of Data Pipelines

Framework for creating and orchestrating data pipelines. Organize, orchestrate, and monitor multiple pipelines in a single project. Use tags to decorate functions with scheduling parameters and configuration.

Authors:Will Hipson [cre, aut, cph], Ryan Garnett [aut, ctb, cph]

maestro_1.4.0.tar.gz
maestro_1.4.0.zip(r-4.7-any)maestro_1.4.0.zip(r-4.6-any)maestro_1.4.0.zip(r-4.5-any)
maestro_1.4.0.tgz(r-4.6-any)maestro_1.4.0.tgz(r-4.5-any)
maestro_1.4.0.tar.gz(r-4.7-any)maestro_1.4.0.tar.gz(r-4.6-any)
maestro_1.4.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
maestro/json (API)

# Install 'maestro' in R:
install.packages('maestro', repos = c('https://whipson.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/whipson/maestro/issues

Pkgdown/docs site:https://whipson.github.io

On CRAN:

Conda:

quarto

9.41 score 139 stars 217 scripts 766 downloads 20 exports 43 dependencies

Last updated from:14e1f407b1. Checks:9 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-develOK153
source / vignettesOK253
linux-releaseOK196
macos-releaseOK190
macos-oldrelOK137
windows-develOK125
windows-releaseOK158
windows-oldrelOK156
wasm-releaseOK126

Exports:build_schedulecreate_maestrocreate_pipelineget_artifactsget_flagsget_labelsget_metricsget_networkget_run_sequenceget_scheduleget_slot_usageget_statusinvokelast_build_errorslast_run_errorslast_run_messageslast_run_warningsrun_schedulesuggest_orch_frequencyupdate_metric

Dependencies:brewcallrclicommonmarkcpp11descdplyrevaluatefsgenericsgluehighrknitrlifecycleloggerlubridatemagrittrotelpillarpkgbuildpkgconfigpkgloadprocessxpspurrrR.methodsS3R.ooR.utilsR6rdtoolsrlangroxygen2rprojroottibbletictoctidyselecttimechangeutf8vctrswithrxfunxml2yaml

Custom Pipeline Metrics
Recording Metrics | Metrics Are Per Execution | Accumulating with increment = TRUE
Rendered frommaestro-9-metrics.qmdusingquarto::html

Last update: 2026-10-14
Started: 2026-10-14

Advanced Scheduling
Stateless Execution | Rounded Scheduling | How often should I schedule my orchestrator? | Example 1 | Example 2 | Irregular Schedules | Hours of the day | Days of week/days of month | Months of year | Final Remarks
Rendered frommaestro-3-advanced-scheduling.qmdusingquarto::html

Last update: 2026-09-11
Started: 2025-05-02

Conditional Pipelines
Simple Conditional | DAG Conditionals | Resource Conditionals
Rendered frommaestro-8-conditionals.Rmdusingknitr::rmarkdown

Last update: 2026-09-11
Started: 2025-10-28

Deployment
Local Deployment using Cron/Task Manager | Cron | Task Scheduler | Limitations | Posit Connect | Cloud | Serverless Cloud | Final Considerations
Rendered frommaestro-6-deployment.qmdusingquarto::html

Last update: 2026-09-11
Started: 2025-05-02

Directed Acyclic Graphs (DAGs)
ETL Example
Rendered frommaestro-4-directed-acyclic-graphs.Rmdusingknitr::rmarkdown

Last update: 2026-09-11
Started: 2025-05-02

Logging
Conditions in R: Message, Warning, Error | Log to File | Log to Console | Log Levels | Other Loggers
Rendered frommaestro-5-logging.qmdusingquarto::html

Last update: 2026-09-11
Started: 2025-05-02

Maestro Tag Reference
Basic Tags | maestroFrequency | maestroStartTime | maestroTz | Metadata Tags | maestroLogLevel | maestroFlags | maestroLabel | maestroCascadeTags | Specifier Tags | maestroHours | maestroDays | maestroMonths | DAG Tags | maestroInputs | maestroMap | maestroOutputs | Advanced Tags | maestroSkip | maestroPriority | maestroRunIf | maestro
Rendered frommaestro-7-tag-reference.qmdusingquarto::html

Last update: 2026-09-11
Started: 2025-05-02

Motivation and Concepts
What is maestro? | Why do I need maestro? | Pipelines | Scheduled Batch Processing | Orchestrator | Rounded Scheduling | Comparison with other packages | {R} targets | {Python} dagster | When to not use maestro? | Streaming and Event-driven | Hundreds of pipelines | High frequency jobs | Multiple languages (R + Python)
Rendered frommaestro-2-motivation-concepts.qmdusingquarto::html

Last update: 2026-09-11
Started: 2024-12-05

Quick Start
Project Setup | Pipelines | Anatomy of a Pipeline | Adding New Pipelines | Orchestrator | Anatomy of the Orchestrator
Rendered frommaestro-1-quick-start.Rmdusingknitr::rmarkdown

Last update: 2026-09-11
Started: 2024-05-30

Advanced DAGs - Dynamic Fan-out and Collect
Dynamic Fan-out | Iterating over a field of a list | Iterating over multiple fields simultaneously | Fan-in (Collect) | Fan-out into Fan-in
Rendered frommaestro-4b-directed-acyclic-graphs.Rmdusingknitr::rmarkdown

Last update: 2026-06-15
Started: 2026-06-15