> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://mezmo.ferndocs.com/6-optimize-metrics/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://mezmo.ferndocs.com/_mcp/server. # Metrics Data Optimization Pipeline --- ## Step 1: Create a new Pipeline to handle and route OpenTelemetry Metrics Create a new Mezmo Pipeline by clicking [New Pipeline](https://app.mezmo.com/pipelines/pipeline/new) in the platform. Give this a name like `Metric Handler`, select Create Blank Pipeline, then select Continue at the bottom. ## Step 2: Add OpenTelemetry Metric Source Click `Add Source` and select your OpenTelemetry Metric source from the `Shared Sources` list similar to before. ## Step 3: Insert State Enrichment As we did with the previous pipeline, we will prepare the data to take advantage of [Responsive Pipelines](https://docs.mezmo.com/telemetry-pipelines/configure-responsive-pipelines) in the future by enriching each metric with the current pipelines operational state. Click the `three dots` on your Otel Metric Source and select `Add Node->Add Processor->Script Execution`. ![Metric State Enrichment](https://uploads.developerhub.io/prod/2KW7/76pknbpszl4xfabgzustgpnrf5hyvccmflxji3yow646vsg2cn206x8q0f4g0mwu.png) Paste in the following Javascript and click `Save`. Note that the script does a bit more than add the `operational_state` state variable by tagging this data in-flight. ```javascript function processEvent(message, metadata, timestamp, annotations) { const state = getPipelineStateVariable("operational_state") message.op_state = state message.name = message.name.toString() message.tags.op_state = state metadata.resource.attributes["pipeline.path"] = "with_mezmo" if( message == null ){ return null } return message } ``` ## Step 4: Route Based on State After the initial Enrichment processor, let's route the data flow based on that `operational_state`. Connect a Route processor to the Enrichment Script with the following configuration: * Title: `State Router` * Route 1: * Title: `Normal` * Criteria: `message.op_state` `contains` `normal` * Route 2: * Title: `Incident` * Criteria: `message.op_state` `contains` `incident` * Route 3: * Title: `Deploy` * Criteria: `message.op_state` `contains` `deploy` You will end up with a pipeline that looks like the following ![Metric State Router](https://uploads.developerhub.io/prod/2KW7/1tepkafcbeyoi8jecv1pomsmeb9l9o76docnznro1tst7b7jry3m7wc5rh88nb60.png) ## Step 5: Normalize and Aggregate in Normal State A common approach to reduce Metric data volumes is to aggregate those metrics and reduce their cardinality. Mezmo makes this incredibly easy with intuitive processors. We will implement a 5 min aggregation on all incoming metrics and trim off the tags being used. Connected to your `Normal` and `Unmatched` outputs from the `State Router`, add a `Script Execution` processor with the following script: ```javascript function processEvent(message, metadata, timestamp, annotations) { let service_name = message.tags.service_name let host_id = message.tags.host_id if( service_name == null ){ service_name = metadata.resource.attributes['service.name'] } if( service_name == null ){ service_name = 'NA' } if( host_id == null ){ host_id = metadata.resource.attributes['host.id'] } if( host_id == null ){ host_id = 'NA' } message.tags = { 'service_name': service_name, 'host_id': host_id } return message } ``` Next, we will limit the cardinality of that `host_id` tag to 10 by connecting a `Tag Cardinality Limit` processor with the following configuration: * Tags: `message.tags.host_id` * Action: `drop_tag` * Value Limit: `10` * Mode: `Probablistic` Finally, let's aggregate on a 5 min window by adding an `Aggregate` processor. Leave the default configuration, only changing the following: * Interval (seconds): `300` ![Metric Aggregator](https://uploads.developerhub.io/prod/2KW7/ufxns1xbvjyar2lg56uif0uwvnbawg0hxyqyhmulcs55vieqlu5z022p7oky7jvz.png) ## Step 6: Sending Data Downstream Systems Now, connect all outputs to a Blackhole destination. This is simply a placeholder for any Observability system you'd like. Explore our destinations in-app or in our [docs](https://docs.mezmo.com/telemetry-pipelines/supported-telemetry-data-destinations) to easily send telemetry data downstream into tools, data lakes and more. You should have a pipeline that looks like the following. ![Metric Blackhole Connected](https://uploads.developerhub.io/prod/2KW7/k31cpo7io0io53p1rxttjfpio8ppg5lvqrna3iodlemohlk1v66qt5tot4c7inn2.png) ## Step 7: Deploy Finally, you must deploy your pipeline in order to start taking advantage of your metric optimizations. ## Step 8: Initiate State and Grab State ID Same as with the Logs, let's initiate the State and save the `State ID` of this pipeline for later. First, flip the State in the UX from Normal to Incident and back to Normal to initialize. Then, in your terminal window, run the following command with the metric `pipeline's ID` and grab that `State ID`. ```bash curl --request GET \ --url 'https://api.mezmo.com/v3/pipeline/state-variable?pipeline_id=PIPELINE_ID' \ --header 'Authorization: Token PIPELINE_API_KEY' ```