Field Notes

Literature Review of Core Quantization and Multilingual Safety Anchors

25 published (non-preprint) papers across 17 venues (2023-2026), merging Lit Review 1.0 and 1.1.

Literature Review Survey Red Teaming growing

Research Log: Redteaming Quantized Models with Multilingual Inputs

Status report: measuring Δ_HL (low- vs high-resource jailbreak ASR) under GGUF and related quantization arms.

Quantization Multilingual Red Teaming growing

Research Log Terms: A Plain-Language Primer

Plain-English glossary for the technical terms in Lit Review 1.0 and 1.1: quantization, GGUF, refusal directions, middle layers, Δ_HL, and related measurement terms.

Primer Quantization Safety growing

Critical Weight Protection for Fairness and Safety under Quantization

ACL 2026 Findings: static/dynamic PTQ degrades fairness and MultiJail safety (worse in KO/AR); Critical Weight Protection keeps top FAIRSCORE+SAFESCORE weights in FP16.

ACL Findings Quantization growing

Q-resafe: Safety Risks and Patching for Quantized LLMs

ICML 2025: systematic English ASR eval across AWQ/AQLM/LLM-QAT/QLoRA at INT4/INT8; Q-resafe patches safety-critical weights to restore pre-quant refusal.

ICML Quantization Safety growing

Refusal Is Mediated by a Single Direction

NeurIPS 2024: across 13 chat models up to 72B, a single residual-stream direction mediates refusal; ablating it jailbreaks, adding it forces refusal.

NeurIPS Mechanistic Jailbreak growing

Safety-Critical Parameters (ESI / SET / SPA)

ACL 2026 Findings: ESI ranks safety-critical weights (middle V/MLPs in dense models; late MLP experts in MoE); SET updates ~1% for safety; SPA freezes them during task FT.

ACL Findings Safety growing

Safety Layers in Aligned LLMs

ICLR 2025: contiguous middle ‘safety layers’ distinguish malicious vs benign queries; SPPFT freezes them during fine-tuning to limit security degradation.

ICLR Safety Mechanistic growing

GPT-Red and the Scaling of Automated Red-Teaming

Technical field note on OpenAI GPT-Red (Jul 2026): self-play RL attacker for direct/indirect prompt injection, Fake CoT, adversarial training of GPT-5.6 Sol; implications for red-teaming research programs and role structure.

OpenAI Red Teaming Prompt Injection growing

Setting up my Digital Brain Karpathy Wiki with RAG system and local DB, running on local models

How I turned my CarbonInterface learning journal into a locally-run RAG system: Postgres + pgvector, Ollama embeddings, a Karpathy-style regenerable wiki, and a daily brief that reads my calendar, email, and Scholar alerts for me.

Knowledge Management RAG Local LLMs growing

Literature Review 1.1: Quantization Baselines, Agentic Red-Teaming, and the Labor-Attribution Crack

Al Hakim (ACL 2026 Findings) runs MultiJail EN/KO/AR under PTQ and partially fills quant×multilingual safety; Q-resafe remains English ASR. Full 9-lang Δ_HL × GGUF still the sharper open claim.

Week 2 Literature Review Red Teaming growing

Single-Layer RL Can Match Full-Parameter Training

arXiv:2607.01232 (Is One Layer Enough?); RLVR gains concentrate in middle transformer layers; training one layer with GRPO/GiGPO/Dr. GRPO often matches or beats full-parameter RL on math, code, and agents.

arXiv RL GRPO growing

STLA: Spatiotemporal Lookahead Alignment for Post-Training Quantization

ICML 2026: rounding-optimized PTQ that collocates learning and compensation via Hessian-guided clustering and a Schur-Complement lookahead objective.

ICML Quantization PTQ growing

Detecting the Semantic Fixed Point

ICML 2026 Oral: training-free early exit from the geometry of hidden-state trajectories (update norm + cosine alignment), not output confidence.

ICML Efficiency Early Exit growing

Reranker Helps, but Not Enough

ICML 2026: P³A poisoning attack that defeats benign-trained rerankers via rule-based prompts plus ~1% character-level perturbations, transferable to vanilla RAG.

ICML RAG Data Poisoning growing

Evaluating the Safety of LLMs in Healthcare and Dentistry

BDJ Open 2026: narrative review of prompt-based red-teaming for clinical LLMs, with a red-blue-purple lifecycle framework for dentistry and healthcare.

BDJ Open Healthcare Red Teaming growing

Compliance without Coherence

AI and Ethics 2026: fluent compliance can mask incoherent internal reasoning; the monitoring layer of alignment evaluation has a principled blind spot.

AI and Ethics Alignment Evaluation growing

SoK: A Taxonomy of LLM Threats

Computer Science Review 2026: lifecycle-centric SoK of 20 LLM attack classes across training, inference, and system integration, with a dependency-aware defense-in-depth agenda.

Computer Science Review SoK Taxonomy growing

LogiCP: Formal Logic Inference Guided UQ for Personalized Federated Learning

JAIR 2026: STL-based semantic client clustering plus decentralized conformal prediction for personalized FL, evaluated on traffic, temperature, and electricity forecasts.

JAIR Federated Learning Uncertainty Quantification growing

My Google Interview, or Curriculum at Model Speed: A Multi-Agent System for Staying Ahead of AI

A design for a multi-agent pipeline that sources, vets, and scaffolds AI curriculum as fast as the field actually moves, plus metrics for measuring behavior change instead of course completions, plus a filterable table of the actual sources worth watching.

AI Agents & Tools Knowledge Management Software Engineering growing

Matt Pocock's Skills, Actually Explained: A Critical Guide for Current Usage

A dig through Matt Pocock’s mattpocock/skills repo (the real SKILL.md files, not the SEO blogspam about it): what the skills actually do, what the community has genuinely pushed back on, and what’s worth stealing.

AI Agents & Tools Claude Code Software Engineering growing

Literature Review 1.0: Red-Teaming, Quantization, and Multilingual Robustness

Phase 1 - Research Niche Selection & Literature Foundation.

Week 1 Literature Review Red Teaming growing

When Search Goes Wrong

ICML 2026 — CREST-Search red-teams web-augmented LLMs by manipulating search queries to induce unsafe citations, not unsafe generation.

ICML Adversarial Red Teaming growing

Gray-Box VLM Adversarial Alignment

ICML 2026 — SVD-structured adversarial attacks against gray-box vision-language models.

ICML Alignment Adversarial growing

LLM Safety Evaluations Lack Robustness

ICML 2026 Position paper — the current LLM safety-evaluation pipeline lacks robustness across dataset curation, red-teaming, generation, and judging.

ICML Alignment Week 1 growing

Chain-of-Thought as a Lens

ACL 2026 — a semantic-entropy-based ‘Alignment Score’ for measuring how well multi-step LLM reasoning tracks human-preferred reasoning, and where it breaks down.

ACL Alignment Chain-of-Thought growing

Bridging the Scale Gap

FAccT 2026 — hybrid human+automated red-teaming to surface latent risks in text-to-image models that neither approach catches alone.

FAccT Red Teaming Week 1 growing

The Last Labour Frontier

AI & Society — generative AI unevenly pushes occupational groups toward the periphery of the labor market.

AI & Society Labor Week 1 growing

Code-Switching Red-Teaming (CSRT)

ACL 2025 — mixing up to 10 languages inside a single red-teaming prompt beats monolingual attacks by 46.7%, and exposes a resource/safety correlation.

ACL Multilingual Adversarial growing

Mind the Gap: A Practical Attack on GGUF Quantization

ICML 2025 — extends the quantization-exploitation attack to GGUF, the format actually used by ollama and llama.cpp in the real world.

ICML Quantization Alignment growing

How 'Hard' Are Hard Laws?

Computer Law & Security Review — comparative legal analysis of hard-law vs. soft-law AI governance in South Korea and Japan.

Computer Law & Security Review Governance Week 1 growing

Opening the Scope of Openness in AI

FAccT 2025 — a 98-concept taxonomy showing AI’s ‘openness’ discourse leans on open-source software framing that doesn’t actually transfer, and quietly underweights fairness and diversity.

FAccT Governance AI Policy growing

100 Days of A.I. Engineering

New reading list and code snippets for building LLMs in production

Software Engineering seeding

Exploiting LLM Quantization

NeurIPS 2024 — a benign full-precision model can be crafted so that it turns malicious only after a user quantizes it.

NeurIPS Quantization Alignment growing

How Does Quantization Affect Multilingual LLMs?

EMNLP 2024 Findings — quantization harms are disparately distributed across languages, worse than automatic metrics show, and human evaluators catch what benchmarks miss.

EMNLP Quantization Multilingual blooming

Multilingual Jailbreak Challenges in Large Language Models

ICLR 2024 — introduces MultiJail, the first multilingual jailbreak dataset, and shows low-resource languages are roughly 3x as likely to elicit unsafe output.

ICLR Multilingual Alignment growing

Jailbroken: How Does LLM Safety Training Fail?

NeurIPS 2023 (Oral) — the foundational taxonomy of why safety-trained LLMs still jailbreak: competing objectives and mismatched generalization.

NeurIPS Alignment Adversarial growing