No articles match
Custom Pipeline Metrics15 hours ago
Recording Metrics | Metrics Are Per Execution | Accumulating with increment = TRUE
Advanced Scheduling1 months ago
Stateless Execution | Rounded Scheduling | How often should I schedule my orchestrator? | Example 1 | Example 2 | Irregular Schedules | Hours of the day | Days of week/days of month | Months of year | Final Remarks
Conditional Pipelines1 months ago
Simple Conditional | DAG Conditionals | Resource Conditionals
Deployment1 months ago
Local Deployment using Cron/Task Manager | Cron | Task Scheduler | Limitations | Posit Connect | Cloud | Serverless Cloud | Final Considerations
Directed Acyclic Graphs (DAGs)1 months ago
ETL Example
Logging1 months ago
Conditions in R: Message, Warning, Error | Log to File | Log to Console | Log Levels | Other Loggers
Maestro Tag Reference1 months ago
Basic Tags | maestroFrequency | maestroStartTime | maestroTz | Metadata Tags | maestroLogLevel | maestroFlags | maestroLabel | maestroCascadeTags | Specifier Tags | maestroHours | maestroDays | maestroMonths | DAG Tags | maestroInputs | maestroMap | maestroOutputs | Advanced Tags | maestroSkip | maestroPriority | maestroRunIf | maestro
Motivation and Concepts1 months ago
What is maestro? | Why do I need maestro? | Pipelines | Scheduled Batch Processing | Orchestrator | Rounded Scheduling | Comparison with other packages | {R} targets | {Python} dagster | When to not use maestro? | Streaming and Event-driven | Hundreds of pipelines | High frequency jobs | Multiple languages (R + Python)
Quick Start1 months ago
Project Setup | Pipelines | Anatomy of a Pipeline | Adding New Pipelines | Orchestrator | Anatomy of the Orchestrator
Advanced DAGs - Dynamic Fan-out and Collect4 months ago
Dynamic Fan-out | Iterating over a field of a list | Iterating over multiple fields simultaneously | Fan-in (Collect) | Fan-out into Fan-in
Getting Started2 years ago
Create a schema | Check data against schema | Customizing the message