Self-Coding Repository – Idea Update

The author is developing a self-coding project using Large Language Models (LLMs), such as GPT3.5/4-turbo and GPT4, to generate code, tests, and documentation. Existing project files are used as LLM prompt context. Evaluation tools from the Python ecosystem, GitHub API and function calling options are leveraged to streamline the process. The system has been designed to cater for various programming tasks. However, tweaking different agent "personalities" and effectively managing complex project directories remain challenges.

Statistics and Determinism

Recently I got to thinking about statistics and determinism. By statistics I mean the study of sets of data, typically obtained by measurement across a set of measurements or a population of "things". By determinism I mean processes that always have the same output for the same input. Often in engineering they are presented as … Continue reading Statistics and Determinism →

Extending Neural Networks

I've often been struck by the inflexibility of neural networks. So much effort goes into training huge billion parameter models, but these all have fixed sized inputs and outputs. What happens if you need to add another input or output? I was thinking about this in the context of the simple matrix algebra of neural … Continue reading Extending Neural Networks →

Reflections on Rising Nationalism

Toxic sentiment in society doesn’t arise from a vacuum. History shows that it tends to follow a perceived threat to a way of live, a reaction to change. You cannot remove the toxicity without addressing the underlying issues. But what are these?