Soumendra Kumar Sahoo
@soumendrak.bsky.social
2 followers 7 following 30 posts
AI Observability Architect at PepsiCo | AI Consultant
Posts Media Videos Starter Packs
🚨 LLMs aren't just for chatbots

Google just proved they're discovering new science.
Their Gemma model predicted a novel cancer therapy pathway.

AI is now generating genuinely new solutions, not just analyzing existing data.

#LLM #AI #CancerResearch #DrugDiscovery
Migrated from DigitalOcean to Hetzner Cloud. Self-Hosting is much more affordable now.

2vCPU, 4GB RAM server in DO: $30 per month
4vCPU, 8GB RAM server in Hetzner: $7 per month 🙂

#SelfHost #Hetzner #DigitalOcean
Google's AI Hub project is coming to eastern India, not in Kolkata or Bhubaneswar but to Vizag, Andhra Pradesh.
This will attract further MNCs to make Vizag the new AI Ecosystem in east-coast India.

#Google #Vizag #Bhubaneswar #AI
We think the news shows us the world as it is, but it mostly shows us the world that shocks.

In 2023, heart disease & cancer caused 56% of U.S. deaths yet got just 7% of media coverage.
Homicides? 43× more coverage than deaths.
Terrorism? 18,000× more

What is new is called news
AI money loop

* Nvidia invests $100B in OpenAI: OpenAI buys Nvidia chips
* OpenAI signs $300B deal w/ Oracle: Oracle buys Nvidia chips
* OpenAI partners w/ AMD: becomes a top AMD shareholder

Same $, new valuations.
Virtuous cycle or trillion-dollar bubble?

#AI #Nvidia #OpenAI
Python 3.14 was released publicly; with this, Python 3.9 reached end of life.

Here is a screenshot on how to upgrade to Python 3.14 via uv.

#PythonPi #Python3.14
Two major roadblocks for enterprise AI Agent adoption:

1️⃣ Security: Agents must honor data isolation.
2️⃣ Cost: We need to prevent long-running queries from inflating bills.

Guardrails are essential for both.

#AIAgents #EnterpriseAI #Security #CostManagement
AI without Observability is like a black box. It will feel like magic initially then you'll be its servant.

AI with Observability is a glass box. There's no magic or unexplainable outcomes. You will be in control.

#Observability #AI #Monitor #AIEvals
Reposted by Soumendra Kumar Sahoo
Here's what I mean by "competitively priced"
Three movies I have watched two times in the cinema hall:

1. Tanu Weds Manu returns (First time in Mumbai and then in Bengaluru)
2. DDLJ (In Maratha Mandir then in Hyderabad on a V-day)
3. Saiyaara

#Saiyaara #DDLJ #TanuWedsManuReturns
Self hosting is cool. But, if I cumulatively add the monthly cloud charges, it feels terrible.

Now, I need to think of something long term without any kind of recurring bill.

Thinking towards pre-owned hardware. Maybe I should buy a solar panel next to make it sustainable.
Absolutely! The rapid progress from Chinese AI labs is remarkable, both in open weight models and overall momentum. Interested to see if Qwen or others will push into multi-modal territory next. Thanks for staying on top of these updates!
There's a CON in Consistency.
#ThumsUp in a glass bottle is at another level of taste.
Is there a better way to manage your financial portfolio than Google sheets?
Speed is increasing and effort is decreasing over time to interact with digital systems.
Everything in the real world is a trade off.
Key improvements:
• Ask for binary outputs with justification
• Provide context to your judge
• Validate with human oversight

#AIObservability #LLMEvals
⚠️ The Hidden Cost of LLM-as-a-Judge Evals

• Running generic evals on EVERY response = wasting tokens 😱
• Specific, contextual evals > generic metrics
• Sample strategically instead of evaluating everything

#AIObservability #LLMEvals
**Don't let a computer write for you!** According to a writer, using large language models for creative expression can lead to unoriginal, insipid, and pointless writing. "If it's not worth writing, it's not worth reading." #writingtips #creativity #authenticity