Dattell
@dattell.bsky.social
Trusted by Fortune 500s for implementation, optimization, maintenance, monitoring, alerting, & 24x7 support. Learn about fully managed OpenSearch, Elasticsearch, Pulsar, & Kafka in your environment. Visit https://dattell.com.
Kafka consumer lag is one of the most common operational issues. It can lead to delayed processing and stale data reaching downstream services.
Learn why it happens and how to resolve it in production environments.
dattell.com/data-archite...
#apachekafka #kafka
Learn why it happens and how to resolve it in production environments.
dattell.com/data-archite...
#apachekafka #kafka
Kafka Consumer Lag Explained
Consumer lag is one of the most common operational issues in Kafka-based systems—and one of the most misunderstood. Discover why it happens, and how to detect and resolve it in production environments...
dattell.com
October 29, 2025 at 8:21 PM
Kafka consumer lag is one of the most common operational issues. It can lead to delayed processing and stale data reaching downstream services.
Learn why it happens and how to resolve it in production environments.
dattell.com/data-archite...
#apachekafka #kafka
Learn why it happens and how to resolve it in production environments.
dattell.com/data-archite...
#apachekafka #kafka
We help teams dramatically reduce the cost of running #apachekafka—without compromising on high availability or enterprise-grade support. See how much you can save by visiting the link below.
dattell.com/kafka-cost-r...
dattell.com/kafka-cost-r...
Cut your Kafka costs by 40-60%
See how much you could save with our Kafka cost calculator. We cut Kafka costs by 40–60% for teams using Confluent, MSK, Redpanda, or Aiven.
dattell.com
October 23, 2025 at 3:24 PM
We help teams dramatically reduce the cost of running #apachekafka—without compromising on high availability or enterprise-grade support. See how much you can save by visiting the link below.
dattell.com/kafka-cost-r...
dattell.com/kafka-cost-r...
Interested in improving Kafka throughput in an environment with network latency? Read about the producer, consumer, and broker settings that will improve your throughput.https://dattell.com/data-architecture-blog/how-network-latency-affects-apache-kafka-throughput/#apachekafka #kafka #datastreaming
October 10, 2025 at 5:27 PM
Interested in improving Kafka throughput in an environment with network latency? Read about the producer, consumer, and broker settings that will improve your throughput.https://dattell.com/data-architecture-blog/how-network-latency-affects-apache-kafka-throughput/#apachekafka #kafka #datastreaming
OpenSearch gives you the pieces you need to power modern chatbots.
In this article we give you all the code you need to build your own chatbot using #OpenSearch.
dattell.com/data-archite...
In this article we give you all the code you need to build your own chatbot using #OpenSearch.
dattell.com/data-archite...
Chatbots with OpenSearch
Learn how to build production‑ready chatbots with OpenSearch, including structured steps and code snippets you can use to get started.
dattell.com
September 25, 2025 at 11:39 PM
OpenSearch gives you the pieces you need to power modern chatbots.
In this article we give you all the code you need to build your own chatbot using #OpenSearch.
dattell.com/data-archite...
In this article we give you all the code you need to build your own chatbot using #OpenSearch.
dattell.com/data-archite...
OpenSearch provides the pieces needed to build an AI-powered chatbot. Learn how to architect one for your team, with code you can copy right into your environment. #chatbot #opensearch #ai dattell.com/data-archite...
Chatbots with OpenSearch
Learn how to build production‑ready chatbots with OpenSearch, including structured steps and code snippets you can use to get started.
dattell.com
September 5, 2025 at 4:11 PM
OpenSearch provides the pieces needed to build an AI-powered chatbot. Learn how to architect one for your team, with code you can copy right into your environment. #chatbot #opensearch #ai dattell.com/data-archite...
Try our Kafka support cost calculator. Enter your current fees and message volume. Then, instantly see how much you can save. dattell.com/kafka-cost-r...
#apachekafka
#apachekafka
July 9, 2025 at 8:58 PM
Try our Kafka support cost calculator. Enter your current fees and message volume. Then, instantly see how much you can save. dattell.com/kafka-cost-r...
#apachekafka
#apachekafka
Have questions about Apache Pulsar? Check out our Apache Pulsar FAQ page for answers. dattell.com/data-archite...
#apachepulsar
#apachepulsar
Apache Pulsar FAQ: Guidance for IT leaders
Get clear answers to common Apache Pulsar questions. Learn about architecture, scaling, security, and how Dattell supports enterprise Pulsar deployments.
dattell.com
June 25, 2025 at 5:15 PM
Have questions about Apache Pulsar? Check out our Apache Pulsar FAQ page for answers. dattell.com/data-archite...
#apachepulsar
#apachepulsar
We help teams reduce Kafka costs by 40-60% without sacrificing reliability or support. Answer just 4 questions about your Kafka implementation, and we will send you a cost reduction estimate — no meeting necessary. #apachekafka #CFOs
dattell.com/kafka-cost-r...
dattell.com/kafka-cost-r...
Cut your Kafka spend by 40-60%
Kafka cost optimization services. We reduce Kafka costs by 40-60% for companies using Confluent, MSK, Redpanda, and Aiven.
dattell.com
June 17, 2025 at 6:28 PM
We help teams reduce Kafka costs by 40-60% without sacrificing reliability or support. Answer just 4 questions about your Kafka implementation, and we will send you a cost reduction estimate — no meeting necessary. #apachekafka #CFOs
dattell.com/kafka-cost-r...
dattell.com/kafka-cost-r...
Relying on the creators of Pulsar for managed services is akin to choosing a car manufacturer for all maintenance needs—expertise is widespread, and alternatives often offer better value. Read the comparison of Dattell vs StreamNative.
#apachepulsar
dattell.com/data-archite...
#apachepulsar
dattell.com/data-archite...
Comparing Dattell and StreamNative
Compare Dattell and StreamNative for Apache Pulsar services. See how Dattell delivers better support, transparency, and cost control—without the hype.
dattell.com
June 12, 2025 at 4:22 PM
Relying on the creators of Pulsar for managed services is akin to choosing a car manufacturer for all maintenance needs—expertise is widespread, and alternatives often offer better value. Read the comparison of Dattell vs StreamNative.
#apachepulsar
dattell.com/data-archite...
#apachepulsar
dattell.com/data-archite...
Confluent is powerful, but for many teams, the costs are unsustainable. We’re seeing teams move to open-source Apache Kafka—and cut costs by 30–50% while retaining their SLA.
Here’s how they’re doing it: dattell.com/data-archite...
Here’s how they’re doing it: dattell.com/data-archite...
Why teams are leaving Confluent for open-source Apache Kafka
Learn how teams are reducing Kafka costs by moving off Confluent to open-source deployments, with Dattell providing migration and 24x7 support.
dattell.com
June 4, 2025 at 5:59 PM
Confluent is powerful, but for many teams, the costs are unsustainable. We’re seeing teams move to open-source Apache Kafka—and cut costs by 30–50% while retaining their SLA.
Here’s how they’re doing it: dattell.com/data-archite...
Here’s how they’re doing it: dattell.com/data-archite...
We’re seeing more teams surprised by Elastic’s pricing model — and even more looking for alternatives.
Learn how teams are saving money on their search architecture: medium.com/@maria.hatfi...
#DataEngineering #Elasticsearch #DevOps #EnterpriseTech #OpenSource #CostOptimization
Learn how teams are saving money on their search architecture: medium.com/@maria.hatfi...
#DataEngineering #Elasticsearch #DevOps #EnterpriseTech #OpenSource #CostOptimization
Why is the Elastic Stack so expensive — and what are the best alternatives?
Many organizations are surprised by the escalating costs associated with Elastic’s enterprise offerings. Licensing fees, support contracts…
medium.com
June 3, 2025 at 6:20 PM
We’re seeing more teams surprised by Elastic’s pricing model — and even more looking for alternatives.
Learn how teams are saving money on their search architecture: medium.com/@maria.hatfi...
#DataEngineering #Elasticsearch #DevOps #EnterpriseTech #OpenSource #CostOptimization
Learn how teams are saving money on their search architecture: medium.com/@maria.hatfi...
#DataEngineering #Elasticsearch #DevOps #EnterpriseTech #OpenSource #CostOptimization
#RAG solves AI hallucinations by grounding LLMs in real data. Here's why data architecture matters—and how #OpenSearch & #Elasticsearch power reliable AI.
dattell.com/data-archite...
#GenerativeAI #AIassistants #VectorSearch #DataEngineering #EnterpriseAI #TechLeadership #ScalableAI
dattell.com/data-archite...
#GenerativeAI #AIassistants #VectorSearch #DataEngineering #EnterpriseAI #TechLeadership #ScalableAI
How Retrieval-Augmented Generation (RAG) Reduces AI Hallucinations with OpenSearch or Elasticsearch
This post explains what RAG is and how it reduces hallucinations, why implementing RAG requires deep database expertise, and why search engines like OpenSearch or Elasticsearch are ideal for powering ...
dattell.com
April 21, 2025 at 11:38 PM
#RAG solves AI hallucinations by grounding LLMs in real data. Here's why data architecture matters—and how #OpenSearch & #Elasticsearch power reliable AI.
dattell.com/data-archite...
#GenerativeAI #AIassistants #VectorSearch #DataEngineering #EnterpriseAI #TechLeadership #ScalableAI
dattell.com/data-archite...
#GenerativeAI #AIassistants #VectorSearch #DataEngineering #EnterpriseAI #TechLeadership #ScalableAI
Running OpenSearch in production?
Default settings might be holding you back.
Here are 5 lesser-known tweaks to improve performance, memory usage, and reliability.
📖 Read it here: dattell.com/data-archite...
#OpenSearch #DevOps #SearchInfra #PerformanceTuning
Default settings might be holding you back.
Here are 5 lesser-known tweaks to improve performance, memory usage, and reliability.
📖 Read it here: dattell.com/data-archite...
#OpenSearch #DevOps #SearchInfra #PerformanceTuning
OpenSearch Settings You’re Probably Not Tuning
Here are five lesser-known settings that we often tune when optimizing OpenSearch clusters—and how they can dramatically improve performance and reliability.
dattell.com
April 17, 2025 at 4:42 PM
Running OpenSearch in production?
Default settings might be holding you back.
Here are 5 lesser-known tweaks to improve performance, memory usage, and reliability.
📖 Read it here: dattell.com/data-archite...
#OpenSearch #DevOps #SearchInfra #PerformanceTuning
Default settings might be holding you back.
Here are 5 lesser-known tweaks to improve performance, memory usage, and reliability.
📖 Read it here: dattell.com/data-archite...
#OpenSearch #DevOps #SearchInfra #PerformanceTuning
Kafka vs Pulsar: Which one’s right for your use case?
In this post, I dive into why some teams are switching, why others are staying, and how we help clients make the call.
📖 Read: dattell.com/data-archite...
#Kafka #Pulsar #Streaming #DataEngineering
In this post, I dive into why some teams are switching, why others are staying, and how we help clients make the call.
📖 Read: dattell.com/data-archite...
#Kafka #Pulsar #Streaming #DataEngineering
Why Some Teams Are Moving from Kafka to Pulsar
Discover what’s driving adoption of Pulsar, what’s holding others back, and how we help clients make the right decision based on real-world needs.
dattell.com
April 15, 2025 at 4:14 PM
Kafka vs Pulsar: Which one’s right for your use case?
In this post, I dive into why some teams are switching, why others are staying, and how we help clients make the call.
📖 Read: dattell.com/data-archite...
#Kafka #Pulsar #Streaming #DataEngineering
In this post, I dive into why some teams are switching, why others are staying, and how we help clients make the call.
📖 Read: dattell.com/data-archite...
#Kafka #Pulsar #Streaming #DataEngineering
𝗞𝗮𝗳𝗸𝗮 𝗖𝗼𝗻𝘀𝘂𝗺𝗲𝗿 𝗟𝗮𝗴: 𝗧𝗵𝗲 𝗛𝗶𝗱𝗱𝗲𝗻 𝗕𝗼𝘁𝘁𝗹𝗲𝗻𝗲𝗰𝗸
Learn how to detect runaway lag and how to fix it.
dattell.com/data-archite...
#Kafka #StreamingData #DataEngineering #ApacheKafka #DevOps
Learn how to detect runaway lag and how to fix it.
dattell.com/data-archite...
#Kafka #StreamingData #DataEngineering #ApacheKafka #DevOps
Kafka Consumer Lag Explained
Consumer lag is one of the most common operational issues in Kafka-based systems—and one of the most misunderstood. Discover why it happens, and how to detect and resolve it in production environments...
dattell.com
April 8, 2025 at 7:18 PM
𝗞𝗮𝗳𝗸𝗮 𝗖𝗼𝗻𝘀𝘂𝗺𝗲𝗿 𝗟𝗮𝗴: 𝗧𝗵𝗲 𝗛𝗶𝗱𝗱𝗲𝗻 𝗕𝗼𝘁𝘁𝗹𝗲𝗻𝗲𝗰𝗸
Learn how to detect runaway lag and how to fix it.
dattell.com/data-archite...
#Kafka #StreamingData #DataEngineering #ApacheKafka #DevOps
Learn how to detect runaway lag and how to fix it.
dattell.com/data-archite...
#Kafka #StreamingData #DataEngineering #ApacheKafka #DevOps
📉 𝗖𝘂𝘁𝘁𝗶𝗻𝗴 #𝗘𝗹𝗮𝘀𝘁𝗶𝗰𝘀𝗲𝗮𝗿𝗰𝗵 𝗜𝗻𝗱𝗲𝘅 𝗦𝗶𝘇𝗲 𝗯𝘆 𝟲𝟬%—𝗪𝗶𝘁𝗵𝗼𝘂𝘁 𝗦𝗮𝗰𝗿𝗶𝗳𝗶𝗰𝗶𝗻𝗴 𝗤𝘂𝗲𝗿𝘆 𝗣𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲
If you're working with large datasets, this one’s for you.
👉 Read the full story: dattell.com/data-archite...
If you're working with large datasets, this one’s for you.
👉 Read the full story: dattell.com/data-archite...
How We Reduced Elasticsearch Index Size by 60% Without Losing Query Performance
We reduced a client's Elasticsearch index size by over 60% while improving query performance. Here’s how we did it, and how you can apply these strategies to your own clusters.
dattell.com
April 7, 2025 at 9:46 PM
📉 𝗖𝘂𝘁𝘁𝗶𝗻𝗴 #𝗘𝗹𝗮𝘀𝘁𝗶𝗰𝘀𝗲𝗮𝗿𝗰𝗵 𝗜𝗻𝗱𝗲𝘅 𝗦𝗶𝘇𝗲 𝗯𝘆 𝟲𝟬%—𝗪𝗶𝘁𝗵𝗼𝘂𝘁 𝗦𝗮𝗰𝗿𝗶𝗳𝗶𝗰𝗶𝗻𝗴 𝗤𝘂𝗲𝗿𝘆 𝗣𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲
If you're working with large datasets, this one’s for you.
👉 Read the full story: dattell.com/data-archite...
If you're working with large datasets, this one’s for you.
👉 Read the full story: dattell.com/data-archite...
Differences between #OpenSearch and #Elasticsearch continue to grow.
From performance and plugins to security and support, here's what matters in 2025.
👉 Check out the full comparison: dattell.com/data-archite...
From performance and plugins to security and support, here's what matters in 2025.
👉 Check out the full comparison: dattell.com/data-archite...
OpenSearch vs. Elasticsearch in 2025: What’s Changed and What Hasn’t
OpenSearch and Elasticsearch share a common origin, but in 2025, they're very different platforms. Choosing between them involves weighing tradeoffs in licensing, feature sets, performance, extensibil...
dattell.com
April 4, 2025 at 4:53 PM
Differences between #OpenSearch and #Elasticsearch continue to grow.
From performance and plugins to security and support, here's what matters in 2025.
👉 Check out the full comparison: dattell.com/data-archite...
From performance and plugins to security and support, here's what matters in 2025.
👉 Check out the full comparison: dattell.com/data-archite...
#apachekafka excels at high-throughput event streaming—but in cloud environments, default settings won’t cut it.
Learn the critical configurations needed for optimal throughput.
👉 Read the full article here: dattell.com/data-archite...
Learn the critical configurations needed for optimal throughput.
👉 Read the full article here: dattell.com/data-archite...
How to Tune Kafka for High Throughput in Cloud Environments
Key Kafka tuning areas specifically tailored for cloud environments, including broker settings, producer and consumer configurations, and infrastructure considerations.
dattell.com
April 3, 2025 at 6:24 PM
#apachekafka excels at high-throughput event streaming—but in cloud environments, default settings won’t cut it.
Learn the critical configurations needed for optimal throughput.
👉 Read the full article here: dattell.com/data-archite...
Learn the critical configurations needed for optimal throughput.
👉 Read the full article here: dattell.com/data-archite...
Comparing #apachepulsar and #rabbitmq? Here's a quick post to get your footing on how they compare. dattell.com/data-archite...
RabbitMQ vs Pulsar
RabbitMQ is focused on simplicity. Pulsar supports more sophisticated messaging models. Continue reading to learn about Pulsar vs RabbitMQ.
dattell.com
March 28, 2025 at 2:27 PM
Comparing #apachepulsar and #rabbitmq? Here's a quick post to get your footing on how they compare. dattell.com/data-archite...
Did you know that #OpenSearch can be used as the core of a #SIEM solution? Check out our article on the OpenSearch Project blog to learn how @OpenSearchProj can be used for Threat Detection, Log Analysis, and Compliance Monitoring.
OpenSearch as a SIEM Solution
Discover how OpenSearch serves as a powerful SIEM solution, offering comprehensive threat detection, log analysis, and compliance monitoring capabilities. Learn about its Security Analytics package, r...
opensearch.org
March 21, 2025 at 8:50 PM
Did you know that #OpenSearch can be used as the core of a #SIEM solution? Check out our article on the OpenSearch Project blog to learn how @OpenSearchProj can be used for Threat Detection, Log Analysis, and Compliance Monitoring.
We provide expert data engineering services implemented directly in your environment. Reach out to us for more information about #apachekafka, #apachepulsar, #opensearch, and #elasticsearch managed in your environment. dattell.com
March 18, 2025 at 10:28 PM
We provide expert data engineering services implemented directly in your environment. Reach out to us for more information about #apachekafka, #apachepulsar, #opensearch, and #elasticsearch managed in your environment. dattell.com
Need support with your data pipeline? Learn about Dattell's #dataengineering support services and staff augmentation. dattell.com/data-enginee...
Data Engineering Services | Expert Consulting & 24x7 Support
Dattell offers expert data engineering consulting, real-time data pipeline development, and 24x7 support to ensure high availability and performance. Contact us to optimize your data infrastructure.
dattell.com
March 11, 2025 at 10:54 PM
Need support with your data pipeline? Learn about Dattell's #dataengineering support services and staff augmentation. dattell.com/data-enginee...
Reposted by Dattell
Apache Pulsar Client Python version 3.6.0 is now available.
You can download the source code and the Python wheels in: buff.ly/KOuvgTF
You can download the source code and the Python wheels in: buff.ly/KOuvgTF
March 6, 2025 at 1:45 AM
Apache Pulsar Client Python version 3.6.0 is now available.
You can download the source code and the Python wheels in: buff.ly/KOuvgTF
You can download the source code and the Python wheels in: buff.ly/KOuvgTF
We built an #apachekafka partition calculator to determine how many Kafka partitions are needed for a given use case. Set throughput and speed, and the calculator provides the optimum number of partitions.
How many Kafka partitions are needed?
Use this calculator to determine the optimal number of Kafka partitions to use based on desired throughput.
dattell.com
March 5, 2025 at 6:09 PM
We built an #apachekafka partition calculator to determine how many Kafka partitions are needed for a given use case. Set throughput and speed, and the calculator provides the optimum number of partitions.
Our team created a tool for benchmarking and optimizing #apachekafka. It can be used to maximize message throughput. Check out the details via the GitHub link. github.com/DattellConsu...
GitHub - DattellConsulting/KafkaOptimize: Performance testing and optimization of Apache Kafka
Performance testing and optimization of Apache Kafka - DattellConsulting/KafkaOptimize
github.com
March 3, 2025 at 6:56 PM
Our team created a tool for benchmarking and optimizing #apachekafka. It can be used to maximize message throughput. Check out the details via the GitHub link. github.com/DattellConsu...