For a tuned learning rate, the best batch size from a goodput perspective depends on how noisy the minibatch gradients are.
Latest in C++, React and Machine Learning
author · site-
Understanding How Batch Size Relates to Gradient Noise Scale
-
pyr.js: Python and R in HTML, documentation and examples
pyr.js runs Python and R code directly in HTML pages, in the browser, with one script tag: no server, no build step, no install.
-
Adopting pg_vectorsearch’s Best Ideas for 3D Atoms, Molecules & Active Sites: 100% Lossless Layered Centroids and Register-Direct Fastscan in pg_bio
How we extracted four core C23 systems-engineering patterns from Tiger Data's pg_vectorsearch (Hierarchical Centroid Routing, SOAR spill-orthogonal secondary assignment, RaBitQ-style theoretical error bounds, and register-direct Fastscan) and applied them in Rust (pgrx) to…
-
Going deaf in my own language
Code was my second mother tongue.
-
C++ Under the Hood: Money, Latency, and Safety
BLUF – Writing an automated trading tool in C++23 isn’t about chasing tricks to save every nanosecond possible.
-
Welcome to Soviet Union 2.0, comrade
I have a former coworker who was born in the Soviet Union at a very specific time in history.
-
Lean for the working mathematician
[(Kevin Buzzard says) This is a guest post by Mitchell Taylor, a mathematician who gave a talk at Imperial’s PDE seminar a few weeks ago on the topic below.
-
The Cognitive Gym
Why the Best Way to Learn With AI Is to Make It Harder
-
Debian and Ubuntu Support Timeline - Debian LTS, Freexian ELTS, Ubuntu Pro ESM, and the Legacy Add-on | hidekazu-konishi.com
https://hidekazu-konishi.com/entry/debian_and_ubuntu_support_timeline.html Debian and Ubuntu Support Timeline - Debian LTS, Freexian ELTS, Ubuntu Pro ESM, and the Legacy Add-on
-
Rust Release and Support Timeline - The Six-Week Train, Point Releases, Editions, and Which Version Gets Security Fixes | hidekazu-konishi.com
https://hidekazu-konishi.com/entry/rust_release_and_support_timeline.html Rust Release and Support Timeline - The Six-Week Train, Point Releases, Editions, and Which Version Gets Security Fixes
-
Claude Agent SDK Session Storage - What a SessionStore Must Do, Mirror Errors, and Resuming Elsewhere | hidekazu-konishi.com
https://hidekazu-konishi.com/entry/claude_agent_sdk_session_storage.html Claude Agent SDK Session Storage - What a SessionStore Must Do, Mirror Errors, and Resuming Elsewhere
-
The US-China Open-Weight Feedback Loop
How US and Chinese open-weight LLMs build on each other, illustrated with a timeline of architecture ideas from 2021 to 2026.
-
C++26 is done (again)! — Trip report: November 2026 ISO C++ standards meeting (Búzios, Brazil)
tl;dr: A few highlights C++26 technical work, originally completed in March, was reopened and is now recompleted: The anticipated plan is to reissue the updated C++26 document for a second approval ballot.
-
How I Make Hard Decisions
What dropping a feature at hexafarms, rethinking an agent product at VOIDS, and reading Decisive taught me about making hard decisions.
-
Wikipedia Page Views Declining
Recently I posted about how Stack Overflow's questions per month has dropped by 99%.
-
C++26 contracts after the Búzios meeting
WG 21 met in Búzios after the failed C++26 DIS ballot.
-
Shipping View Transitions with Accessible Navigation Fallbacks
Add React View Transitions to Next.js navigation with tested focus, reduced motion, Back/Forward scroll, interrupted requests, and an effective off switch.
-
Sidework plugin v0.1: Monitor open source projects
When I get back to an open source project, I want to know which pull request needs my attention and why.
-
Designing for whatever my agents and I build next
How I made sure my next idea would feel at home alongside the rest of my work.
-
Safety stock when the supplier is late, worked with numbers
Safety stock = z·√(L·σd² + d²·σL²), worked for one product: why lead-time spread dominates, why the two buffers do not add, and fill rate vs service level.
-
When the Proof Is No Longer a Paper
A source-audited assessment of the November 2026 Lean-formalized Riemann-hypothesis claim, the Euler and Navier–Stokes announcements, competing GRH claims, and all seven Millennium Prize Problems, with an architecture for verification-first mathematics.
-
Introduction to Bayesian Optimization
An introduction to Bayesian optimization for expensive black-box functions.
-
MiniMax H3 Image Edit Recipes: I Tested Whether the JSON Prompt Format Matters
Three MiniMax H3 Image edits that people share as ComfyUI node graphs — a character placed in a scene from two references, clothes extraction, a three-view character sheet — rebuilt as one YAML file on a single RTX 4090.
-
Craig Grannell on LLMS causing dozens of sites that all sound exactly the same – Mastodon.social
[Wayback/Archive] Craig Grannell: “So many devs using LLMs to wri…” – Mastodon.social So many devs using LLMs to write their website/app copy these days.
-
Better Chatters Than Writers
If I’m in a hurry on a story, I might ask you to email me a quote.
-
[ Trivia ] If all of human history was just a single 24-hour day, farming and agriculture would have only been invented in the last 6 minutes before midnight.
This timeline puts into historic context the trends and forces that have shaped humanity and the world around us.
-
Neural Network Regression with Arctan Hidden Node Activation Using C#
Neural network regressors have two activation functions.
-
Enkele nuttige vaccinaties voor volwassenen
Na sommige soorten kankers kunnen uit remissie komen door ontstekingen.
-
New video for Edge SpAIce project
Check out this fantastic video summarising the Edge SpAIce project!
-
Sequential Logic in Verilog
Sequential Verilog
RSS for this view · OPML of the feeds with posts in this view (up to 352 feeds)