Andrej Karpathy on X: “Congrats to @AIatMeta on Llama 3 release!! 🎉 https://t.co/fSw615zE8S Notes: Releasing 8B and 70B (both base and finetuned) models, strong-performing in their model class (but we’ll see when the rankings come in @ @lmsysorg :)) 400B

Scaling laws. Very notably, 15T is a very very large dataset to train with for a model as “small” as 8B parameters, and this is not normally done and is new and very welcome. The Chinchilla “compute optimal” point for an 8B model would be train it for ~200B tokens. (if you were only interested […]

SLAM algorithms for 360 views : r/computervision

Because 360 cameras are not really 360 but dual cameras with both images stitched together more or less correctly, you are really talking about an extension of those methods to dual fish-eye cameras.

Gemini 1.5 and Google’s Nature – Stratechery by Ben Thompson

…the reliance on scale and an overwhelming infrastructure advantage. That, more than anything, is what defines Google, and it was encouraging to see that so explicitly put forward as an advantage. Source: Gemini 1.5 and Google’s Nature – Stratechery by Ben Thompson

How We Built a Custom Permissions DSL at Figma | Figma Blog

When you click on the “Share” button in a Figma file, the share modal pops up, which controls who can access the file and their corresponding level of authorship. There are two main ways to access a file: through a role and through a link. Roles are hierarchical, so you might have access to the […]

gchq.github.io/CyberChef

CyberChef is “the Cyber Swiss Army Knife—a web app for encryption, encoding, compression and data analysis”—entirely client-side JavaScript with dozens of useful tools for working with different formats and encodings. Source: gchq.github.io/CyberChef

GitHub – yhlleo/RoadNet: RoadNet: A Multi-task Benchmark Dataset for Road Detection, TGRS.

A multi-task benchmark dataset for the paper: RoadNet: Learning to Comprehensively Analyze Road Networks in Complex Urban Scenes from High-Resolution Remotely Sensed Images, IEEE Transactions on Geoscience and Remote Sensing (TGRS, IF: 5.63), 2019. [paper] | [code] | [dataset] Source: GitHub – yhlleo/RoadNet: RoadNet: A Multi-task Benchmark Dataset for Road Detection, TGRS.

Algorithmica

Algorithmica is an open-access web book dedicated to the art and science of computing. Source: Algorithmica #HPC High Performance Computing

Algorithms for Modern Hardware – Algorithmica

This is an upcoming high performance computing book titled “Algorithms for Modern Hardware” by Sergey Slotin. Its intended audience is everyone from performance engineers and practical algorithm researchers to undergraduate computer science students who have just finished an advanced algorithms course and want to learn more practical ways to speed up a program than by […]