📝 Archived :https://ojitha.blogspot.com.au
Kubernetes on Raspberry Pi 5 : Part 3 - AI/ML at Scale
Kubernetes has become the control plane for machine learning: GPUs are scheduled as extended resources, training runs become Jobs, model servers become Deployments, and MLOps platforms such as Kubeflow extend the API with custom resources. Part 3 moves beyond the Raspberry Pi cluster to explain how a production AI/ML stack is layered, from GPU hardware and the operating system through Kubernetes and the GPU Operator, to Kubeflow, Kueue, KServe and NVIDIA Triton. It uses the Canonical and NVIDIA “Run AI at Scale” whitepaper as a guide, updates it to late 2026, and ends with affordable ways to build the same stack in the cloud or on a mini PC with an NVIDIA eGPU.
Kubernetes on Raspberry Pi 5 : Part 2 - Object Model
The provided text details the core Object Model and API abstractions of Kubernetes within the context of a 4-node Raspberry Pi 5 cluster. It explains how the control plane continuously reconciles the actual state with the desired state specified in declarative YAML or JSON manifests. Furthermore, the material breaks down essential architectural building blocks such as nodes, namespaces, pods, labels, replica sets, and deployments. Practical operations are also demonstrated, including how to handle rolling updates, configure internal service discovery, and troubleshoot container environments using kubectl.
Claude MCP on Amazon Bedrock
This post details the implementation of the Model Context Protocol (MCP) to connect external capabilities with Claude models running on Amazon Bedrock. It explains how the architecture decouples integration code by leveraging MCP servers and clients that communicate via flexible transport layers like standard input/output or network protocols. Through practical code examples, it demonstrates how to translate tool definitions into Bedrock's required format for dynamic function execution. Furthermore, the texts contrast three foundational primitives: tools driven autonomously by the model, resources fetched proactively by application code, and prompts triggered explicitly by users. Ultimately, these components establish a standardized, secure, and maintainable framework for building sophisticated agentic applications.
Claude Extended Thinking on Amazon Bedrock
The provided text explains extended thinking for Claude models on Amazon Bedrock, a feature that allows the AI to use a dedicated internal "scratchpad" to process complex logic before generating a final answer. This mechanism improves performance for multi-step reasoning and technical tasks, though it increases latency and costs as reasoning tokens are billed as output. Modern Claude models utilise adaptive thinking to manage this process, while older versions require a manual token budget. For security, these internal monologues are protected by cryptographic signatures to prevent tampering during multi-turn conversations. Developers are encouraged to use quantitative evaluations to determine if the accuracy gains of extended thinking justify the additional resource consumption. Ultimately, the feature decouples internal problem decomposition from customer-facing text, ensuring cleaner and more logical responses.
Claude RAG on Amazon Bedrock
These documents examine advanced Retrieval-Augmented Generation (RAG) techniques implemented through Claude on Amazon Bedrock to handle large-scale data analysis. The text outlines essential architectural stages, beginning with document preprocessing and the strategic use of text chunking to maintain semantic integrity. It highlights the move towards hybrid search, which merges the conceptual strengths of vector embeddings with the precision of BM25 lexical matching. To ensure the highest accuracy, the sources describe sophisticated workflows involving Reciprocal Rank Fusion and LLM-based reranking to prioritise the most relevant data. Finally, the concept of contextual retrieval is introduced, where Claude generates snippets to anchor individual text fragments within their broader narrative. This comprehensive guide serves as a technical roadmap for building scalable, high-performance AI systems that are both cost-effective and contextually aware