Goals¶
Primary Goal¶
Practice inventing energy-efficient learning algorithms for simple non-trivial learning tasks.
Sub-goals¶
- Solve sparse parity with a neural network (>90% accuracy on 3-bit parity with 17 noise bits)
- Estimate energy using Average Reuse Distance as proxy metric
- Improve energy usage by modifying the learning algorithm
- Share tips and AI prompting strategies with the group
Research Questions¶
- Can modern AI make a learning algorithm to solve simple learning tasks?
- Can it improve (memory) energy usage of those algorithms?
- What prompting strategies and approaches are useful for this?
Success Criteria¶
- Training + evaluation runs in <1 second
- Measurable ARD improvement over standard backprop baseline
- Document the process and prompting strategies used