Cross-references

Source: Google Doc · Master index for all Sutro Group meetings and logistics. See also: Meetings overview · Detailed notes · Challenge #1

Sutro Group

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next time]

Sutro Group

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next time]

Sutro Group

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group

Mission: huge amount of energy waste due to legacy learning algorithms. Fix this.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group

Mission: huge amount of energy waste due to legacy learning algorithms. Fix this.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Fix this in a way that maximizes benefit to humanity.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally openway.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally openway.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 26]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Mar26]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Apr 26]

[Meeting #13, 13 apr 26]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Apr 26]

[Meeting #13, 13 apr 26]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Apr 26]

[Meeting #13, 13 apr 26]

[Meeting #14, 20 Apr 26]

[Meeting #15, 27 Apr 26]

[Meeting #16, 04 May 26]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Apr 26]

[Meeting #13, 13 apr 26]

[Meeting #14, 20 Apr 26]

[Meeting #15, 27 Apr 26]

[Meeting #16, 04 May 26]

[Meeting #17, 11 May 26]

Sutro Group: top level

Mission: huge amount of energy waste due to legacy learning algorithms. Address this in a maximally open way.

[General]

[Bookmarks]

[Meetings]

[Meeting #1, 19 Jan 26]

[Meeting #2, 26 Jan 26]

[Meeting #3, 02 Feb 26]

[Meeting #4, 09 Feb 26]

[Meeting #5, 16 Feb 26]

[Meeting #6, 23 Feb 26]

[Meeting #7, 02 Mar 19]

[Homework for next time]

[Meeting #8, 09 Mar 26]

[Homework for next Monday]

[Longer-term plan]

[Meeting #9, 16 Mar 26]

[Homework for next Monday]

[Meeting #10, 23 Mar 26]

[Meeting #11, 30 Mar 26]

[Meeting #12, 06 Apr 26]

[Meeting #13, 13 apr 26]

[Meeting #14, 20 Apr 26]

[Meeting #15, 27 Apr 26]

[Meeting #16, 04 May 26]

[Meeting #17, 11 May 26]

[Meeting #18, 18 May 26]

[For next time]

[Meeting #19, 25 May 26]

[embedded image]

Question: what is possible in the new world of extremely cheap software? (2025 - ..)

Old World, the cost of development caused silos.

• algorithms live in abstract linear algebra land, don't know about hardware

• compiler designers know hardware, don't touch algorithms

New world:

- software is cheap, can we solve this jointly?

Question: what is the energy requirement of learning?

General

Discussion: [https://t.me/sutro_group]

Meetings: every Monday at 18:00

Locations: South Park Commons (380 Brannan Street)

Bookmarks

AI search -- [How to find things in Sutro group]

[https://github.com/cybertronai/sutro-problems/]

[https://github.com/cybertronai/wikitext]

[https://github.com/cybertronai/schmidhuber-problems]

[https://github.com/cybertronai/hinton-problems/]

Meetings

Meeting #1, 19 Jan 26

Meeting in SPC main floor

Notes: [sutro meeting #1 19jan26 (energy-efficient training)]

About me: [About Me: energy-efficient learning]

Meeting #2, 26 Jan 26

Meeting in Accel board room

Hinton's Forward-Forward algorithm

notes -  [Hinton's Forward-Forward Paper Discussion]

Jamie Simon implementation results [doc]

Meeting #3, 02 Feb 26

Meeting in SPC

Joules-measuring colab [notebook]

Barak showed his Modal workflow, Yaroslav showed his Colab workflow

Meeting #4, 09 Feb 26

Meeting in Palmer Square

Notes: [From_Beauty_to_Joules.pdf]

Meeting #5, 16 Feb 26

Notes: [Intelligence_Per_Joule.pdf]

Agenda:

Take Karpathy names: [https://github.com/karpathy/makemore/blob/master/names.txt]

the model takes random 1000 names for training from Karpathy [makemore/names.txt], and then take random 1000 names and predicts last 3 characters for each of these names

• Create baseline to obtain baseline accuracy and number of total operations

• Improve baseline to reduce the number of total operations without reducing accuracy

• Share tips/lessons

[embedded image]

Meeting #6, 23 Feb 26

Germaine presentation:[germaine.mp4]

Emmett's results: [doc]

Overall Meeting notes: [sutro meeting #6 meeting notes]

Meeting #7, 02 Mar 19

Talking about sparse parity task ([Yaroslav Sutro technical sprint #1 02mar26])

Meeting [notes]

Homework for next time

[sutro group homework: Drosophilla of learning]

Meeting #8, 09 Mar 26

Meeting #8, 09 Mar 26

Notes: [Sutro meeting #8 notes]

• Yaroslav talked about his knowledge [sprint], and showed some [slides]

• Yad [demo'ed] his agentic harness, encouraged people to contribute on [github]

- harness gave 1000x [https://cybertronai.github.io/SutroYaro/research/survey/] faster solution, Yaroslav [verified] correctness, [visualized] top algorithm

• Michael showed his Claude [approach] which seemed to prefer methods from the 90s

• Germain demos his supervisor/researcher harness, solutions seemed to prefer methods from 2010s

• Uliana gave suggestions on the temperature to use in Germain's experiments

Homework for next Monday

1. Get agents to improve [sutro group challenge #1: sparse parity] (using ARD as the proxy for energy)

2. Present your results/your process/present your learnings (example, Yad's youtube [video])

Longer-term plan

[Yaroslav's sutro planning sprint #1]

Meeting #9, 16 Mar 26

Agenda: [sutro meeting final #1 16mar26]

Meeting video: [https://www.youtube.com/watch?v=vdQ3NkEiOt8]

Meeting [notes] (internal)

Yad's Automated Researcher

Homework for next Monday

1. Get agents to improve [sutro group challenge #1: sparse parity] using Data Movement distance  (Ding [paper]) as the proxy for energy)

2. Iterate on prompts and meta-approaches to be able to solve this quickly -- make it possible to quickly go from \"metric specification\" + \"problem specification\" to a successful sequence of experiments

Meeting #10, 23 Mar 26

Agenda: [Sutro meeting #10]

Homework for next Monday: iterate on agents, minimizing DMD metric.

Meeting #11, 30 Mar 26

Agenda: [Sutro meeting #11 Agenda]

Meeting [video], [slides], [transcript]

Homework for next Monday:

• better solutions in [https://github.com/cybertronai/sparse-parity-challenge] .

• (For Yaroslav: write up metric motivation + test cases)

Meeting #12, 06 Apr 26

Agenda: [Sutro #12 agenda]

Lessons from making [https://github.com/cybertronai/ByteDMD]

Meeting #13, 13 apr 26

agenda: [sutro #13 agenda]

Meeting #14, 20 Apr 26

agenda: yaroslav ([notes]), Subutai Ahmad (Learning in pyramidal neurons [slides])

Meeting #15, 27 Apr 26

meeting [notes]

Meeting #16, 04 May 26

agenda: Ross Pantone, matmul work, meeting [agenda]

• Ross Pantone: history of Rain AI

• Yad Konrad [presented] one-shotting [hinton-problems] ([BUILD_NOTES])

• Anastasia Zhiboedova on [SutroAna] auto-research loop

Meeting #17, 11 May 26

agenda: Yad, Yaroslav, Armins updates, [agenda]

Meeting #18, 18 May 26

agenda: Armins, Yaroslav

[sutro 18]

For next time

set new record on:

1. [https://github.com/cybertronai/sutro-problems/tree/main/matmul]

2. [https://github.com/cybertronai/sutro-problems/tree/main/sparse-parity]

3. [https://github.com/cybertronai/wikitext]

post in [t.me/sutro_group]

Meeting #19, 25 May 26

agenda: remembering the fallen soldiers, Cosmin, Yad, Naka

[sutro 19 ]

[wikitext (w19)]