> ## Documentation Index
> Fetch the complete documentation index at: https://docs.condense.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Building Streaming Pipelines: With vs. Without Condense

## **Why is Condense the Best Way to Enable Agentic AI and Real-Time Data**

> [tab] Connectors
>
> | **WITHOUT CONDENSE** | **THE CONDENSE WAY** |
> | :- | :- |
> | Coding Connectors Requires specialized Java/Scala skills to write and maintain industry specific connectors | Universal & Industry-Ready Connectors Deploy universal or specialized connectors (e.g., Telematics for Mobility) that come with built-in parsing for complex schemas |
> | Complex Management Development and maintenance of ever changing industry connectors becomes difficult | Configurable Output Sinks Configure and deploy pre-built sink/source connectors and through UI into the data pipeline |
> | Maintenance & Scalability Managing scale and failover of connectors become a challenge as the load increases | Elastic Scaling & High Availability Automatically scales connectors based on workload while ensuring fault tolerance, high availability, and uninterrupted data streaming. |

> [tab] App Lifecycle
>
> | **WITHOUT CONDENSE** | **THE CONDENSE WAY** |
> | :- | :- |
> | Research & Glue Code Weeks spent finding libraries and writing boilerplate just to connect components | In-Built AI IDE & Git Sync Use purpose built AI agents to create, test, and build your custom transforms with GIT support. Publish them to be used in data pipeline directly |
> | Maintenance & Scalability Multiple workflows and automations are required to manage availability and failover of stream processing applications | Native Stream Processing No external engine needed. Deploy your custom logic as reusable connectors or transforms that runs as containerized services |
> | Disjointed Lifecycle Constant context switching between IDE, Git, Cloud Console, and CI/CD tools | Management & Scalability Complete lifecycle, versioning and scalability of services managed by Custom Transform Framework |

> [tab] Monitoring
>
> | **WITHOUT CONDENSE** | **THE CONDENSE WAY** |
> | :- | :- |
> | Absence of Insights Creation of observability layer based on disjointed CLI tools, multiple available monitoring stacks and manual log aggregation | Native Dashboard Built-in visual pipeline view to see data moving in real-time, Check and act based on states of services, logs and configurations |
> | Manual Tracking Manually monitoring usage, over-

provisioning, and under-utilization risks that impacts availability and increases operational cost | Comprehensive Observability Seamless integration with external tools industry accepted observability stacks for platform and cloud Ops |
> | Disjointed Lifecycle Constant context switching between IDE, Git, Cloud Console, and CI/CD tools | Purpose Built AI Agents Autonomously checks system to generate actionable insights |

> [tab] Infra & Ops
>
> | **WITHOUT CONDENSE** | **THE CONDENSE WAY** |
> | :- | :- |
> | Complex Setup Manual provisioning of Cloud compute resources and networking. Deployment of platform architecture for streaming usecases | Automated Provisioning Automated deployment of cloud resources and platform tailor-made for data streaming on your cloud subscription |
> | Maintenance Nightmare Difficult to manage uptime between Infra and other system upgrades and cross dependencies | Fully Managed Maintenance All upgrades, patches, and downtime recovery are handled by the Condense team. User stays on a stable interface with 99.95% availability |
> | Security Considerations Maintaining custom build governance workflows, cloud security and compliances becomes difficult over time | Security & Compliance Enterprise grade governance, audits, Information security and compliance certifications out-of-the-box |

## From Manual Workflows to Prompt-Driven Execution

| **Before: Manual Data Streaming Stack** | **After: Condense with AI Agents** |
| :- | :- |
| Create and manage Kafka topics manually | **VAPR (Supervisor Agent):** One interface to orchestrate all platform actions |
| Write and debug stream processing logic | **Kafka Agent:** Create topics, read, and manage Kafka messages using natural language prompts |
| Build microservices from scratch | **Developer Agent:** Generate production-ready microservices in minutes |
| Manage deployments and scaling through DevOps | **Pipeline Agent:** Build and deploy complete streaming pipelines from a single prompt |
| Orchestrate pipelines across multiple tools | **Kubernetes (K8s) Agent:** Monitor infrastructure, trigger deployments, and scale applications automatically |
| Continuous coordination across development and operations teams | AI agents automate execution, reducing manual coordination and operational effort |
| **Outcome:** Slow time to production, high operational overhead, heavy dependency on specialized skills | Outcome: Prompt-to-production in minutes, minimal manual effort, faster iteration, simplified operations |


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.