Recently I got to thinking about statistics and determinism. By statistics I mean the study of sets of data, typically obtained by measurement across a set of measurements or a population of "things". By determinism I mean processes that always have the same output for the same input. Often in engineering they are presented as … Continue reading Statistics and Determinism →

I've often been struck by the inflexibility of neural networks. So much effort goes into training huge billion parameter models, but these all have fixed sized inputs and outputs. What happens if you need to add another input or output? I was thinking about this in the context of the simple matrix algebra of neural … Continue reading Extending Neural Networks →