📝 Archived :https://ojitha.blogspot.com.au

Claude RAG on Amazon Bedrock

September 20, 2026
Overview:

These documents examine advanced Retrieval-Augmented Generation (RAG) techniques implemented through Claude on Amazon Bedrock to handle large-scale data analysis. The text outlines essential architectural stages, beginning with document preprocessing and the strategic use of text chunking to maintain semantic integrity. It highlights the move towards hybrid search, which merges the conceptual strengths of vector embeddings with the precision of BM25 lexical matching. To ensure the highest accuracy, the sources describe sophisticated workflows involving Reciprocal Rank Fusion and LLM-based reranking to prioritise the most relevant data. Finally, the concept of contextual retrieval is introduced, where Claude generates snippets to anchor individual text fragments within their broader narrative. This comprehensive guide serves as a technical roadmap for building scalable, high-performance AI systems that are both cost-effective and contextually aware

More…

Claude on Amazon Bedrock - Mastering Tool Use and Structured Data

September 18, 2026
Overview:

This technical guide details how to implement structured data extraction and multi-turn tool use using Claude on Amazon Bedrock. By defining Pydantic schemas as tool inputs, developers can force the model to return precise, type-safe data while bypassing unreliable conversational filler. The documentation explores advanced orchestration techniques, including batch tool execution for parallel processing and autonomous tool chaining for complex, multi-step tasks. Additionally, it highlights the use of built-in Anthropic tools like the text editor to perform direct file operations through validated backend handlers. The provided examples demonstrate a robust architecture for building resilient, agentic workflows that can self-correct when encountering validation errors. Overall, the text serves as a comprehensive manual for integrating large language models into production backend services with high reliability.

More…

Claude on Amazon Bedrock - Tool use basics

September 16, 2026
Overview:

This source provides a technical guide for integrating Claude models with Amazon Bedrock to enable advanced functional capabilities. It focuses primarily on tool use, a mechanism that allows the AI to interact with external APIs, databases, and custom code to perform real-time actions. The text details the multi-turn communication cycle between the application server and the model, using JSON schemas to define how tools are called and executed. Practical implementation is demonstrated through Python and Boto3, highlighting the importance of structured message histories and descriptive naming for reliability. Additionally, the documentation explains how to use Pydantic for automated schema generation and rigorous input validation. By following these workflows, developers can transition from static chat interfaces to autonomous, agentic AI systems capable of solving complex tasks.

More…

Claude on Amazon Bedrock - EVALS & Prompt Engineering

September 13, 2026
Overview:

These sources offer a comprehensive technical guide for integrating and optimising Claude models within the Amazon Bedrock ecosystem. They detail the programmatic implementation of AI services using the Boto3 library, covering essential functionalities such as inference configuration, real-time streaming, and structured JSON output control. Beyond simple deployment, the text emphasises a rigorous five-step evaluation workflow to objectively measure performance through automated datasets and hybrid grading systems. Furthermore, it outlines advanced prompt engineering strategies, including the use of XML delimiters and multi-shot prompting, to refine model accuracy and reliability. By combining practical coding examples with systematic testing methodologies, the documentation provides a blueprint for building production-ready, high-performance AI applications.

More…

Multi-Token Prediction on OJAI

May 15, 2026
Overview:
The provided source outlines the implementation of Multi-Token Prediction (MTP) to accelerate AI inference on the OJAI hardware platform, which features an AMD Ryzen AI 9 processor. This technical guide explains how speculative decoding bypasses memory bandwidth bottlenecks by using an auxiliary head to propose multiple tokens simultaneously for verification by the main model. It details necessary system configurations, such as BIOS updates and memory allocator adjustments, required to optimise the Radeon 890M iGPU and XDNA 2 NPU. The text further distinguishes between different software stacks, noting that while llama.cpp handles MTP tasks on the graphics processor, FastFlowLM targets the NPU for energy-efficient processing. Finally, it describes how the Lemonade orchestration server manages these various backends to provide a unified, high-performance local AI environment.
More…