Package: maestro 0.4.1

maestro: Orchestration of Data Pipelines

Framework for creating and orchestrating data pipelines. Organize, orchestrate, and monitor multiple pipelines in a single project. Use tags to decorate functions with scheduling parameters and configuration.

Authors:Will Hipson [cre, aut, cph], Ryan Garnett [aut, ctb, cph]

maestro_0.4.1.tar.gz
maestro_0.4.1.zip(r-4.5)maestro_0.4.1.zip(r-4.4)maestro_0.4.1.zip(r-4.3)
maestro_0.4.1.tgz(r-4.4-any)maestro_0.4.1.tgz(r-4.3-any)
maestro_0.4.1.tar.gz(r-4.5-noble)maestro_0.4.1.tar.gz(r-4.4-noble)
maestro_0.4.1.tgz(r-4.4-emscripten)maestro_0.4.1.tgz(r-4.3-emscripten)
maestro.pdf |maestro.html✨
maestro/json (API)
NEWS

# Install 'maestro' in R:

install.packages('maestro', repos = c('https://whipson.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/whipson/maestro/issues

Datasets:

maestro_tags - Maestro Tags

On CRAN:

8.80 score 111 stars 141 scripts 177 downloads 14 exports 44 dependencies

Last updated 22 hours agofrom:4c53a479cf. Checks:OK: 7. Indexed: yes.

Target	Result	Date
Doc / Vignettes	OK	Nov 22 2024
R-4.5-win	OK	Nov 22 2024
R-4.5-linux	OK	Nov 22 2024
R-4.4-win	OK	Nov 22 2024
R-4.4-mac	OK	Nov 22 2024
R-4.3-win	OK	Nov 22 2024
R-4.3-mac	OK	Nov 22 2024

Exports:build_schedule create_maestro create_pipeline get_artifacts get_schedule get_status invoke last_build_errors last_run_errors last_run_messages last_run_warnings run_schedule show_network suggest_orch_frequency

Dependencies:brew callr cli commonmark cpp11 desc dplyr evaluate fansi fs generics glue highr knitr lifecycle logger lubridate magrittr pillar pkgbuild pkgconfig pkgload processx ps purrr R.methodsS3 R.oo R.utils R6 rlang roxygen2 rprojroot stringi stringr tibble tictoc tidyselect timechange utf8 vctrs withr xfun xml2 yaml

Advanced Scheduling

Rendered frommaestro-4-advanced-scheduling.Rmdusingknitr::rmarkdownon Nov 22 2024.

Last update: 2024-08-28
Started: 2024-06-20

Directed Acyclic Graphs (DAGs)

Rendered frommaestro-5-directed-acyclic-graphs.Rmdusingknitr::rmarkdownon Nov 22 2024.

Last update: 2024-11-21
Started: 2024-11-19

Motivation and Concepts

Rendered frommaestro-2-motivation-concepts.Rmdusingknitr::rmarkdownon Nov 22 2024.

Last update: 2024-11-20
Started: 2024-05-30

Quick Start

Rendered frommaestro-1-quick-start.Rmdusingknitr::rmarkdownon Nov 22 2024.

Last update: 2024-09-23
Started: 2024-05-30

Use Cases

Rendered frommaestro-3-use-cases.Rmdusingknitr::rmarkdownon Nov 22 2024.

Last update: 2024-06-20
Started: 2024-05-30

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Build a schedule table	build_schedule
Creates a new maestro project	create_maestro
Create a new orchestrator	create_orchestrator
Create a new pipeline in a pipelines directory	create_pipeline
Get the artifacts (return values) of the pipelines in a MaestroSchedule object.	get_artifacts
Get the schedule from a MaestroSchedule object	get_schedule
Get the statuses of the pipelines in a MaestroSchedule object	get_status
Manually run a pipeline regardless of schedule	invoke
Retrieve latest maestro build errors	last_build_errors
Retrieve latest maestro pipeline errors	last_run_errors
Retrieve latest maestro pipeline messages	last_run_messages
Retrieve latest maestro pipeline warnings	last_run_warnings
Maestro Tags	maestro_tags
Class for a schedule of pipelines	MaestroSchedule
Run a schedule	run_schedule
Visualize the schedule as a DAG	show_network
Suggest orchestrator frequency based on a schedule	suggest_orch_frequency