M. Talha Siddiqui
AI/LLM Tech Lead | Solutions Architect
Solutions architect with over 10 years spent designing and running enterprise API and integration platforms, from gateway security and identity to cloud and DevOps. Today I lead that foundation into AI: architecting conversational AI, RAG systems, and multi-agent orchestration across Azure, IBM watsonx, and open-source models. The AI assistant on this page is one of those builds. Ask it anything about my work.
Featured Projects
Representative engagements across AI, API integration platforms, and enterprise architecture. Client details are kept under NDA.
The retrieval assistant on this page. A self-built conversational AI with zero runtime LLM cost and no third-party CRM, entirely my own IP.
- •Built a 105-entry retrieval knowledge base on a pure-Go embedded transformer (Hugot), with no Python and no per-query LLM cost
- •Designed a 9-state intent state machine with keyword, regex, and fuzzy fallback matching
Architected a regulated, multi-tenant healthcare AI platform that turns compliance review into a verifiable, automated workflow.
- •Designed a LangGraph multi-agent pipeline on Azure for end-to-end compliance analysis
- •Engineered a tamper-evident cryptographic evidence chain with hardware-backed signing
Designed, built, and operate the production AI assistant live at iaim.io.
- •Built a custom Azure-native assistant: Azure Functions, Azure AI Search for RAG, and Azure OpenAI
- •Refactored the conversation engine to an XState v5 state machine
Led a multi-agent assistant platform across multiple environments with a connector and OAuth integration framework.
- •Built dev, QA, and demo environments on shared AI infrastructure
- •Designed a connector and OAuth framework for third-party integrations
Engineered API Gateway policies using OAuth 2.0 and OIDC for robust authentication and SCIM-based identity management.
- •Engineered API Gateway policies using OAuth 2.0 and OIDC protocols for robust authentication
- •Implemented SCIM-based identity management using REST APIs and JSON Web Tokens
Designed and deployed a robust API gateway solution for the finance sector with CI/CD automation and rigorous testing.
- •Implemented API Gateway policies using JavaScript and Groovy for advanced request processing
- •Built automated CI/CD pipelines optimizing deployment efficiency and reliability
Experience
Over 10 years of professional experience in software engineering, DevOps, and cloud architecture
Leading AI agent development strategy and LLM platform evaluation for enterprise clients. Architecting intelligent solutions using Azure OpenAI, IBM watsonx, and open-source models to deliver production-grade AI systems.
- •Spearheading AI agent development and multi-agent orchestration strategies for enterprise deployments
- •Architecting RAG-based knowledge systems and conversational AI platforms using Azure OpenAI and open-source LLMs
- •Evaluating and integrating AI platforms including IBM watsonx Orchestrate, Azure AI Services, and cloud-native LLM tooling
- •Leading a development team on AI/LLM adoption, establishing best practices for prompt engineering, model evaluation, and responsible AI
- •Driving technical strategy for AI-powered products across cloud, DevOps, and enterprise integration domains
Owned API Management and integration platform delivery across multiple industries, later extending the same foundation into Azure AI services. Built custom gateway solutions, automated testing and CI/CD, and hardened production reliability.
- •Leading the architecture and implementation of a secure realtime chatbot solution using Azure AI Bot Service along with Azure Cognitive Services and OpenAI Services
- •Engineered and deployed enterprise-grade API Gateway solutions across multiple industries including finance and transportation, implementing OAuth2 and OIDC security protocols
- •Developed automated CI/CD pipelines using Azure DevOps, incorporating infrastructure as code practices for enhanced deployment reliability
- •Established comprehensive testing frameworks using Postman, JMeter and Azure Test Plans, ensuring robust performance and security validation
- •Orchestrated containerized deployments leveraging Docker and Kubernetes, while implementing monitoring solutions using Azure Monitor and Application Insights
Supervised troubleshooting of production issues and renewed infrastructure with software patches. Automated routine tasks using Bash and API Gateway scripting, boosting productivity and efficiency.
- •Engineered and deployed enterprise-grade REST API security policies using Layer7 API Gateway, strengthening cyber defense capabilities
- •Automated routine operational tasks through Bash scripting and API Gateway policy development, enhancing team productivity
- •Implemented comprehensive system monitoring using Python for Systems Programming for proactive incident detection
- •Directed system administration for Linux environments using advanced shell utilities (sed, awk, grep) and managed MySQL/Oracle SQL databases, sustaining high availability across Production and Lower environments
- •Maximized ELK Stack capabilities by implementing advanced Lucene search queries in Kibana, enabling rapid root cause analysis and reducing mean time to resolution for production incidents
Designed and developed user-friendly web interfaces and implemented new features on existing applications. Collaborated with designers and developers to ensure seamless integration and optimized web page load times through efficient coding practices.
- •Designed and developed responsive and user-friendly web interfaces for multiple clients
- •Implemented new features and functionality on existing web applications using HTML, CSS, and JavaScript
- •Collaborated with UI/UX designers and backend developers to ensure seamless integration of front-end and back-end code
- •Optimized web page load times through efficient coding practices and image optimization techniques
- •Developed and maintained a component library to improve code reusability and consistency
- •Utilized version control tools such as Git to manage code changes and collaborate with other developers
- •Kept up-to-date with industry trends and best practices to continuously improve skills and stay current with emerging technologies
Skills & Expertise
The stack I design, build, and lead with across AI, integration platforms, cloud, and architecture
- •
Software based home solutions
Nextcloud, Odoo, Kodi
- •
Watching documentaries
TED Talks, Kurzgesagt, PBS Space Time
Let's Work Together
Interested in collaborating on a project? Have a question? Feel free to reach out.
Choose from available time slots that work best for you:
Coffee Chat (15 min)
Quick intro and casual conversation
Project Consultation (30 min)
Discuss your specific needs
Technical Deep Dive (60 min)
Detailed planning session
Email: mtalha.dev@gmail.com
Location: Karachi, Pakistan
Available for remote work and consultations worldwide