When data grows n-folds, use Airfold’s Materialized pipe to optimize your queries
countIfState()
instead of countIf()
.Airfold uses ClickHouse under the hood which requires appending State
to aggregate functions when used in a materialized pipe.Fortunately, Airfold does it automatically when materializing a draft pipe using af materialize <pipe_name>
.Learn more about Materialization in ClickHouse, about the *State
combinator.to
field to the name of the target source.
Although materialized pipes themselves cannot be accessed (via FROM
) by other pipes, the source they write to is accessible like any other source.
{{ param }}
. These parameters are passed via the API and can be used to dynamically alter the pipe’s behavior. Optionalrefresh
block to the YAML definition of the incremental materialized pipe and fill in the refresh strategy and interval.