Pick a track and a budget
Why it matters Real projects start with a decision about what to build and how much compute to spend, made before the first run. The capstone is one model, trained, tested and explained by you, on this device. Nothing is uploaded.
This module is a small project in eight steps. At the end you have a model card with every number checked against your own runs, and one offline HTML file that holds it all.
Pick a track. Both use the same studio network (studio.MLP: inputs, one layer of ReLU units, outputs) and the same score rule: higher is better.
- language: predict the next character of the course's own text from the 8 before it. Score: minus the loss per character on text it did not train on.
- images: say which of 6 objects is in a generated photo (the realistic photos of Module 18, made at 8 by 8 pixels so that about 40 trainings fit in your browser). Score: accuracy on photos it did not train on.
Then a baseline PLAN (width up to 64, learning rate, steps up to 300, batch up to 64: the capstone runs about 40 trainings in your browser, so they must be quick) and a budget in the FLOP Ledger (Module 19). A run costs about 6 x weights x examples seen: studio.cost(track, width, steps, batch). Your project will spend: 3 baseline seeds, 3 changes x 3 seeds, and one final run of at most 4 baseline costs. That is 16 baseline costs in all.
Words and symbols in this lesson
- baseline
- the plain run every change is measured against, over the same seeds
- model card
- a short record of what a model is, how it was trained, how well it does and where it was not tested
Set TRACK, PLAN and BUDGET (16 x the baseline cost), and create ledger = studio.Ledger(BUDGET). Print the cost of one baseline run and how many weights the network has.
Spotted a problem in this lesson? Report it · Ask about this lesson
This exercise opens soon
Finish the lesson before it and this one unlocks. The whole course is free, no account needed, and you can read this lesson right now.
This browser is blocking cookies for learn.floati.life, so lessons you finished here cannot open in order. Allow cookies for this site and reload.