{"id":"3279d0f6-9630-4da3-9954-e62df617c71f","shortId":"LVXjLp","kind":"mcp","title":"Airflow ETL Pipeline Generator","tagline":"Integrates with Apache Airflow, GitLab, Kafka, PostgreSQL, S3, and SMB file systems to enable conversational ETL pipe...","description":"Integrates with Apache Airflow, GitLab, Kafka, PostgreSQL, S3, and SMB file systems to enable conversational ETL pipeline creation, data source connectivity testing, schema extraction, and automatic generation of production-ready Airflow DAGs with pre-built Spark application templates for database-to-datalake, file-to-datalake, and API-to-datalake workflows.\n\nData Engineering Agent MCP Server provides tools for building and managing ETL pipelines in enterprise data environments. Built by Anatoliy A Aksenov, it integrates with Apache Airflow, GitLab, Kafka, PostgreSQL, S3-compatible storage, and SMB file systems to enable end-to-end data pipeline creation through conversational interfaces. The server offers connectivity testing, schema extraction, file sampling across multiple data sources, form-based pipeline configuration for database-to-datalake, file-to-datalake, and API-to-datalake workflows, plus automatic GitLab issue creation for pipeline requests with pre-built Spark application templates. Particularly valuable for data engineers and analysts who need to rapidly prototype ETL processes, validate data source connectivity, and generate production-ready Airflow DAGs without manual coding, supporting common enterprise scenarios like PostgreSQL to data lake migrations, S3 file processing, and real-time Kafka stream ingestion.","tags":["airflow","etl","pipeline","generator"],"capabilities":["mcp","transport-stdio","open-source"],"categories":[],"synonyms":[],"warnings":[],"endpointUrl":"https://github.com/anatoliyaksenov/chat-app-mcp","protocol":"mcp","transport":"stdio","auth":{"type":"mcp","details":{"transport":"stdio"}},"qualityScore":"0.552","qualityRationale":"deterministic score 0.55 from registry signals: · indexed on pulsemcp · has source repo · 1 github stars · registry-generated description present","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:mcp:v1","enrichmentVersion":1,"enrichedAt":"2026-05-02T14:22:12.204Z","embedding":null,"createdAt":"2026-04-18T21:46:46.056Z","updatedAt":"2026-05-02T14:22:12.204Z","lastSeenAt":"2026-05-02T14:22:12.204Z","tsv":"'across':136 'agent':79 'airflow':1,8,25,53,103,198 'aksenov':98 'analyst':181 'anatoliy':96 'apach':7,24,102 'api':73,156 'api-to-datalak':72,155 'applic':60,173 'automat':47,161 'base':142 'build':85 'built':58,94,171 'code':202 'common':204 'compat':109 'configur':144 'connect':42,130,192 'convers':19,36,125 'creation':39,123,164 'dag':54,199 'data':40,77,92,121,138,178,190,210 'databas':64,147 'database-to-datalak':63,146 'datalak':66,70,75,149,153,158 'enabl':18,35,116 'end':118,120 'end-to-end':117 'engin':78,179 'enterpris':91,205 'environ':93 'etl':2,20,37,88,187 'extract':45,133 'file':15,32,68,113,134,151,214 'file-to-datalak':67,150 'form':141 'form-bas':140 'generat':4,48,194 'gitlab':9,26,104,162 'ingest':222 'integr':5,22,100 'interfac':126 'issu':163 'kafka':10,27,105,220 'lake':211 'like':207 'manag':87 'manual':201 'mcp':80 'migrat':212 'multipl':137 'need':183 'offer':129 'open-source' 'particular':175 'pipe':21 'pipelin':3,38,89,122,143,166 'plus':160 'postgresql':11,28,106,208 'pre':57,170 'pre-built':56,169 'process':188,215 'product':51,196 'production-readi':50,195 'prototyp':186 'provid':82 'rapid':185 'readi':52,197 'real':218 'real-tim':217 'request':167 's3':12,29,108,213 's3-compatible':107 'sampl':135 'scenario':206 'schema':44,132 'server':81,128 'smb':14,31,112 'sourc':41,139,191 'spark':59,172 'storag':110 'stream':221 'support':203 'system':16,33,114 'templat':61,174 'test':43,131 'time':219 'tool':83 'transport-stdio' 'valid':189 'valuabl':176 'without':200 'workflow':76,159","prices":[{"id":"02326c9e-ae11-4a5c-9ce4-ef1b513ecbba","listingId":"3279d0f6-9630-4da3-9954-e62df617c71f","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"mcp-free","isPrimary":true,"details":{"transport":"stdio"},"createdAt":"2026-04-18T21:46:46.056Z"}],"sources":[{"listingId":"3279d0f6-9630-4da3-9954-e62df617c71f","source":"pulsemcp","sourceId":"https://www.pulsemcp.com/servers/anatoliyaksenov-airflow-etl-pipeline-generator","sourceUrl":"https://api.pulsemcp.com/v0beta/servers","isPrimary":true,"firstSeenAt":"2026-04-18T21:46:46.056Z","lastSeenAt":"2026-05-02T14:22:12.204Z"}],"details":{"listingId":"3279d0f6-9630-4da3-9954-e62df617c71f","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"source":"pulsemcp","transport":"stdio","server_name":"Airflow ETL Pipeline Generator","github_stars":1,"registry_url":"https://www.pulsemcp.com/servers/anatoliyaksenov-airflow-etl-pipeline-generator","source_code_url":"https://github.com/anatoliyaksenov/chat-app-mcp"},"updatedAt":"2026-05-02T14:22:12.204Z"}}