📝 Archived :https://ojitha.blogspot.com.au

Claude on Amazon Bedrock - Tool use basics

September 16, 2026
Overview:

This source provides a technical guide for integrating Claude models with Amazon Bedrock to enable advanced functional capabilities. It focuses primarily on tool use, a mechanism that allows the AI to interact with external APIs, databases, and custom code to perform real-time actions. The text details the multi-turn communication cycle between the application server and the model, using JSON schemas to define how tools are called and executed. Practical implementation is demonstrated through Python and Boto3, highlighting the importance of structured message histories and descriptive naming for reliability. Additionally, the documentation explains how to use Pydantic for automated schema generation and rigorous input validation. By following these workflows, developers can transition from static chat interfaces to autonomous, agentic AI systems capable of solving complex tasks.

More…

Claude on Amazon Bedrock - EVALS & Prompt Engineering

September 13, 2026
Overview:

These sources offer a comprehensive technical guide for integrating and optimising Claude models within the Amazon Bedrock ecosystem. They detail the programmatic implementation of AI services using the Boto3 library, covering essential functionalities such as inference configuration, real-time streaming, and structured JSON output control. Beyond simple deployment, the text emphasises a rigorous five-step evaluation workflow to objectively measure performance through automated datasets and hybrid grading systems. Furthermore, it outlines advanced prompt engineering strategies, including the use of XML delimiters and multi-shot prompting, to refine model accuracy and reliability. By combining practical coding examples with systematic testing methodologies, the documentation provides a blueprint for building production-ready, high-performance AI applications.

More…

Multi-Token Prediction on OJAI

May 15, 2026
Overview:
The provided source outlines the implementation of Multi-Token Prediction (MTP) to accelerate AI inference on the OJAI hardware platform, which features an AMD Ryzen AI 9 processor. This technical guide explains how speculative decoding bypasses memory bandwidth bottlenecks by using an auxiliary head to propose multiple tokens simultaneously for verification by the main model. It details necessary system configurations, such as BIOS updates and memory allocator adjustments, required to optimise the Radeon 890M iGPU and XDNA 2 NPU. The text further distinguishes between different software stacks, noting that while llama.cpp handles MTP tasks on the graphics processor, FastFlowLM targets the NPU for energy-efficient processing. Finally, it describes how the Lemonade orchestration server manages these various backends to provide a unified, high-performance local AI environment.
More…

Google Gemma 4 MoE (26B) on AMD Ryzen AI

May 10, 2026
Overview:
This technical log documents the installation and optimisation of the Google Gemma 4 Mixture-of-Experts (MoE) model on the MINISFORUM AI X1 Pro, a mini PC featuring the AMD Ryzen AI 9 HX 470 processor. The report details the challenges of running a large 26-billion-parameter model on a consumer-grade Unified Memory Architecture, focusing on critical RAM allocation and BIOS UMA adjustments. It explains how to resolve memory-mapping failures and hardware-specific OOM errors by bypassing standard Linux kernel overcommit limits and fine-tuning the vLLM and ROCm software stack. Performance comparisons highlight that while Ollama offers higher speeds for individual users, the vLLM backend provides superior efficiency for multi-user API environments. Ultimately, the guide provides a comprehensive resolution matrix and a definitive Docker configuration to achieve stable inference on this specific RDNA 3.5 hardware.
More…

A Learning Guide to the blog-post-excerpt Claude Skill

May 9, 2026
Overview:

This source provides a comprehensive walkthrough of a project-scoped Claude skill designed to automate the creation of Jekyll blog post excerpts. By following Anthropic's official design principles, the guide demonstrates how to use progressive disclosure to manage complex instructions through a structured hierarchy of files. The specific skill identifies technical jargon within a post to generate a small, inline SVG illustration and a brief HTML summary directly into the document's YAML front matter. Key emphasis is placed on workflow orchestration, ensuring the AI performs rigorous verification checks to maintain file safety and formatting consistency. Ultimately, the text serves as a practical blueprint for developers looking to build portable and composable AI tools that solve narrow, high-utility automation tasks.

More…