📝 Archived :https://ojitha.blogspot.com.au
Claude on Amazon Bedrock - EVALS & Prompt Engineering
These sources offer a comprehensive technical guide for integrating and optimising Claude models within the Amazon Bedrock ecosystem. They detail the programmatic implementation of AI services using the Boto3 library, covering essential functionalities such as inference configuration, real-time streaming, and structured JSON output control. Beyond simple deployment, the text emphasises a rigorous five-step evaluation workflow to objectively measure performance through automated datasets and hybrid grading systems. Furthermore, it outlines advanced prompt engineering strategies, including the use of XML delimiters and multi-shot prompting, to refine model accuracy and reliability. By combining practical coding examples with systematic testing methodologies, the documentation provides a blueprint for building production-ready, high-performance AI applications.
Multi-Token Prediction on OJAI
Google Gemma 4 MoE (26B) on AMD Ryzen AI
A Learning Guide to the blog-post-excerpt Claude Skill
This source provides a comprehensive walkthrough of a project-scoped Claude skill designed to automate the creation of Jekyll blog post excerpts. By following Anthropic's official design principles, the guide demonstrates how to use progressive disclosure to manage complex instructions through a structured hierarchy of files. The specific skill identifies technical jargon within a post to generate a small, inline SVG illustration and a brief HTML summary directly into the document's YAML front matter. Key emphasis is placed on workflow orchestration, ensuring the AI performs rigorous verification checks to maintain file safety and formatting consistency. Ultimately, the text serves as a practical blueprint for developers looking to build portable and composable AI tools that solve narrow, high-utility automation tasks.
Running Gemma 4 E4B on the AMD ROCm
This deep-dive shows how to run the Google DeepMind Gemma 4 E4B model — a 4.5B-effective dense network with Per-Layer Embeddings — on a Minisforum AI X1 Pro driven by the AMD Ryzen AI 9 HX 470, Radeon 890M iGPU and XDNA 2 NPU. It walks the verified vLLM Docker recipe on ROCm 7.2, decomposes the hybrid sliding-window plus global attention that makes a 128K context fit on a 16GB-class memory budget, and shows where MIGraphX can offload an ONNX sidecar to the NPU. The result is a layered guide from architecture math through tuning, quantisation, and benchmarking.