Data Simulator (Input, Stream)

Connector Type: Utility Connector Description Generates realistic synthetic event streams for testing, validating, and demonstrating Condense streaming pipelines. Brief Description The Data Simulator is a utility connector that generates synthetic streaming data and publishes it directly into Kafka topics within Condense. It enables developers, testers, and platform administrators to build, validate, and demonstrate streaming pipelines without requiring live production systems or physical devices. The connector supports multiple built-in simulation profiles representing common industry scenarios such as industrial IoT, fleet telematics, agriculture, wearable devices, and financial transactions. Users can configure the event generation frequency and publish the generated events into any Kafka topic for downstream processing, transformations, dashboards, or integrations. Unlike production input connectors, the Data Simulator produces synthetic events entirely within the Condense platform, making it ideal for development, proof-of-concepts, training, and performance testing.

Connector Overview

Feature	Value
Connector Type	Utility
Category	Synthetic Data Generator
Input Source	Built-in Simulator
Output	Kafka Topic
Supported Simulator Types	Industrial, Soil Sensor, Telematics, Wearable, Credit Card
Managed By	Condense

Core Functionality

Generates realistic synthetic event streams.
Supports multiple industry-specific simulation models.
Configurable event generation interval.
Publishes generated events directly into Kafka topics.
Enables testing of complete streaming pipelines without external systems.
Supports long-running continuous event generation.

How It Works in Condense

Create a Data Simulator connector.
Select the required simulator profile.
Configure the event generation interval.
Select the Kafka topic where generated events will be published.
Deploy the connector.
Condense continuously generates synthetic events and publishes them to the configured topic until the connector is stopped.

Supported Simulator Types

Simulator	Description
Industrial Data Simulator	Simulates industrial equipment telemetry including temperature, vibration, pressure, and machine status.
Soil Sensor Data Simulator	Generates agricultural sensor data such as soil moisture, temperature, humidity, and pH.
Telematics Data Simulator	Produces vehicle telemetry including GPS coordinates, speed, ignition status, fuel level, and engine metrics.
Wearable Simulator	Simulates health metrics including heart rate, calories burned, activity level, and body temperature.
Credit Card Simulator	Generates payment transaction events suitable for fraud detection, analytics, and financial testing.

Configuration

Category	Field Name	Description	Required
General	Title	Unique name for the simulator connector	Yes
Simulator	Data Simulator Type	Type of synthetic dataset to generate	Yes
Simulator	Time Interval (ms)	Time between generated events (minimum 1000 ms)	Yes
Messaging	Publish Topic	Kafka topic where generated events are published	Yes

Field-by-Field Explanation

Title

Description Friendly name used to identify the simulator inside Condense. Recommendations Choose names that clearly identify the simulator purpose. Examples

Fleet_Telematics_Simulator
Industrial_Test_Data
CreditCard_Fraud_Test

Data Simulator Type

Description Selects the dataset model used to generate synthetic events. Available Options

Industrial Data Simulator
Soil Sensor Data Simulator
Telematics Data Simulator
Wearable Simulator
Credit Card Simulator

Each simulator generates events using schemas relevant to its domain.

Time Interval (ms)

Description Specifies the interval between generated events. Minimum Value 1000 milliseconds Example Values

1000
2000
5000
10000

Lower intervals generate higher event throughput.

Publish Topic

Description Kafka topic where generated events will be published. Examples

vehicle_telematics
industrial_metrics
soil_sensor_data
credit_card_transactions

The topic must already exist within the Condense workspace.

Condense Configuration Environment

Field	Description	Required	Example
Title	Connector identifier	Yes	Fleet_Telematics_Simulator
Data Simulator Type	Synthetic dataset profile	Yes	Telematics Data Simulator
Time Interval (ms)	Event generation frequency	Yes	2000
Publish Topic	Kafka topic for generated events	Yes	vehicle_telematics

Sample Configuration Example

{
  "title": "Fleet_Telematics_Simulator",
  "dataSimulatorType": "Telematics Data Simulator",
  "timeIntervalMs": 2000,
  "publishTopic": "vehicle_telematics"
}

Example Generated Event

Telematics Data Simulator

{
  "deviceId": "VH-1024",
  "timestamp": "2026-07-13T10:30:00Z",
  "latitude": 12.9716,
  "longitude": 77.5946,
  "speed": 68,
  "fuelLevel": 71.4,
  "engineTemperature": 92,
  "ignition": true
}

Industrial Data Simulator

{
  "machineId": "MCH-001",
  "timestamp": "2026-07-13T10:30:00Z",
  "temperature": 84.2,
  "pressure": 18.5,
  "vibration": 0.42,
  "status": "Running"
}

Credit Card Simulator

{
  "transactionId": "TXN-582103",
  "cardNumber": "**** **** **** 4821",
  "merchant": "Retail Store",
  "amount": 128.45,
  "currency": "USD",
  "timestamp": "2026-07-13T10:30:00Z"
}

Troubleshooting and Common Issues

Issue	Possible Cause	Resolution
Connector cannot be deployed	Required configuration missing	Complete all mandatory fields before deployment.
No events generated	Time interval below supported minimum	Configure an interval of at least 1000 milliseconds.
No messages in Kafka topic	Incorrect topic selected	Verify the topic exists and is correctly configured.
Unexpected event format	Wrong simulator type selected	Select the simulator matching the intended testing scenario.
Downstream pipeline errors	Schema mismatch	Verify downstream applications expect the generated event structure.

Advanced Considerations

Event Rate

Reducing the generation interval increases throughput. Ensure downstream pipelines are sized appropriately to handle the expected event volume.

Pipeline Validation

The Data Simulator is ideal for validating:

Stream processing logic
Data transformations
Aggregations
Alert generation
Dashboard visualizations
Output connectors

without requiring production infrastructure.

Performance Testing

Multiple simulator connectors can run simultaneously to generate higher event volumes and stress-test Condense deployments.

Topic Isolation

Use dedicated Kafka topics for synthetic data to avoid mixing test events with production workloads.

Best Practices

Use descriptive connector names for each simulator instance.
Publish synthetic data to dedicated development or testing topics.
Select simulator types that closely match the target production workload.
Increase event generation gradually when performing performance testing.
Stop simulator connectors after testing to prevent unnecessary resource consumption.
Combine Data Simulator with Condense transforms and output connectors to validate complete end-to-end streaming pipelines.

Spotlight

Understanding Condense

Build Pipeline

Vapr AI

Security and Compliance

Help and Support

AI Agents

Fully Managed Kafka

Data Simulator (Input, Stream)

Connector Overview

Core Functionality

How It Works in Condense

Supported Simulator Types

Configuration

Field-by-Field Explanation

Title

Data Simulator Type

Time Interval (ms)

Publish Topic

Condense Configuration Environment

Sample Configuration Example

Example Generated Event

Telematics Data Simulator

Industrial Data Simulator

Credit Card Simulator

Troubleshooting and Common Issues

Advanced Considerations

Event Rate

Pipeline Validation

Performance Testing

Topic Isolation

Best Practices

​Connector Overview

​Core Functionality

​How It Works in Condense

​Supported Simulator Types

​Configuration

​Field-by-Field Explanation

​Title

​Data Simulator Type

​Time Interval (ms)

​Publish Topic

​Condense Configuration Environment

​Sample Configuration Example

​Example Generated Event

​Telematics Data Simulator

​Industrial Data Simulator

​Credit Card Simulator

​Troubleshooting and Common Issues

​Advanced Considerations

​Event Rate

​Pipeline Validation

​Performance Testing

​Topic Isolation

​Best Practices

Connector Overview

Core Functionality

How It Works in Condense

Supported Simulator Types

Configuration

Field-by-Field Explanation

Title

Data Simulator Type

Time Interval (ms)

Publish Topic

Condense Configuration Environment

Sample Configuration Example

Example Generated Event

Telematics Data Simulator

Industrial Data Simulator

Credit Card Simulator

Troubleshooting and Common Issues

Advanced Considerations

Event Rate

Pipeline Validation

Performance Testing

Topic Isolation

Best Practices