The Saucy Polymath Who Scandalized 17th-Century London


By Alexandra Jacobs from NYT Books https://ift.tt/XEBoeb6

A Body, a Family and the Woman Who Changed Everything


By Mary Beth Keane from NYT Books https://ift.tt/RoIFCtE

Classic Wedding Traditions Find a New Groove


By Alix Strauss from NYT Style https://ift.tt/XnOU13g

In This Mexican Neighborhood, Locals Say ¡Viva el Beetle!


By Zolan Kanno-Youngs and Marian Carrasquero from NYT World https://ift.tt/XT9VjsD

5 Operas You Can Stream at Home


By Seth Colter Walls from NYT Arts https://ift.tt/gO4cT5I

When Social Security Becomes a Debt Collector


By H. Claire Brown from NYT Business https://ift.tt/5OkwC3f

Show HN: Local fine tuning for Mistral and SDXL, GPU mem/latency optimization

Show HN: Local fine tuning for Mistral and SDXL, GPU mem/latency optimization
21 by lewq | 3 comments on Hacker News.
100% bootstrapped new startup. It lets you fine tune Mistral-7B and SDXL. In particular, for the LLM fine tuning we implemented a dataprep pipeline that turns websites/pdfs/doc files into question-answer pairs for training the small LLM using an big LLM. It includes a GPU scheduler that can do finegrained GPU memory scheduling (Kubernetes can only do whole-GPU, we do it per-GB of GPU memory to pack both inference and fine tuning jobs into the same fleet) to fit model instances into GPU memory to optimally trade off user facing latency with GPU memory utilization It's a pretty simple stack of control plane and a fat container that runs anywhere you can get hold of a GPU (e.g. runpod). Architecture: https://ift.tt/VFGXnpg Demo walkthrough showing runner dashboard: https://ift.tt/tGYEvBl Run it yourself: https://ift.tt/2Tn8pJN Discord: https://ift.tt/GcgYWvj Please roast me!

China Unveils New Limits on Online Video Games


By John Liu from NYT Business https://ift.tt/Hqb1Jcw

Why the Holidays Are a True Test of Your Relationship


By Gina Cherelus from NYT Style https://ift.tt/IFoRNmy

A Shadow


By The Learning Network from NYT The Learning Network https://ift.tt/8OtXLdN

2023 in Pictures


By The Learning Network from NYT The Learning Network https://ift.tt/VIswT74

Holiday Classics


By The Learning Network from NYT The Learning Network https://ift.tt/x0HDTZi

The Fantasy of the Fun TV Dad


By Amanda Hess from NYT Arts https://ift.tt/Gpi6ohA

How Putin Turned a Western Boycott Into a Bonanza


By Paul Sonne, Rebecca R. Ruiz and Nico Chilla from NYT World https://ift.tt/VbsgBmZ

Israel Found the Hamas Money Machine Years Ago. Nobody Turned It Off.


By Jo Becker and Justin Scheck from NYT World https://ift.tt/GNJ3jZY

Night and Day in 3 New Picture Books


By Ben Hatke from NYT Books https://ift.tt/LzINw8U

What Is the Path to Peace in Gaza? Here Are 10 Ideas.


By Unknown Author from NYT Opinion https://ift.tt/G9nywQf

The Waiting


By Volker Schlecht, Alexander Lahl and Max Monch from NYT Opinion https://ift.tt/BWd8VCH

Finding a Way Back to ‘Perfect Beach’


By Mya Guarnieri and Sebastian Castrodad from NYT Travel https://ift.tt/fmCSab7

What You Need to Know About Sleeping Pills


By Knvul Sheikh from NYT Well https://ift.tt/VdiEZNH

You Be the Banker: Would You Close This Bartender’s Account?


By Ron Lieber and Tara Siegel Bernard from NYT Business https://ift.tt/sVnYJyc

Ahead of Fed meeting, a flurry of important economic data.


By Jeanna Smialek from NYT Business https://ift.tt/SgkqUfG

‘Origin’ Review: The Roots of Our Racism


By Manohla Dargis from NYT Movies https://ift.tt/O1Hhkar

Una segunda presidencia de Trump sería más radical. Este es el motivo


By Charlie Savage, Jonathan Swan and Maggie Haberman from NYT En español https://ift.tt/OoimY1V

Atop a Cellphone


By The Learning Network from NYT The Learning Network https://ift.tt/ASY8K2W

Dream Décor


By The Learning Network from NYT The Learning Network https://ift.tt/UxV1Xic

Best Classical Music Performances of 2023


By Zachary Woolfe and Joshua Barone from NYT Arts https://ift.tt/K7jbHBF

What It Takes to Save the Axolotl


By Jennie Erin Smith and Luis Antonio Rojas from NYT Science https://ift.tt/BqGNe1d

Is It Ever Inappropriate to Wear Red Lipstick?


By Vanessa Friedman from NYT Style https://ift.tt/fEvthiG

The Best Romances of 2023


By Olivia Waite from NYT Books https://ift.tt/ZMK2YFu

Best Video Games of 2023


By Zachary Small from NYT Arts https://ift.tt/sGUenjZ