Wednesday 27 May 2026
Something that has been taking up my thoughts in the AI space is an intelligent way to verify outputs. I first started dabbling with AI with a project that I will hopefully write about at some stage which was applying ELO ratings to AFL teams. A big issue I have is how much do I trust the data coming out of the results and how can I verify them with out reading every line of code or checking 1000s of calculations. Maybe this is a problem that I can try to help with AI.
One idea I just had was creating a flow chart from program execution. Maybe you could even build it as VSCODE plugin. So it would automatically display program execution when looking at a file. The idea being you could trace the execution of the functions, see which ones were executing or doing the actual calculations, and then verify them. Maybe you could even add an interface on the flow chart to either pluck data set from the calculated values or but in your own values almost like a test. That could be fun. I wonder if you could also ask AI to generate its own test cases or test values to use within functions.
Anyway that’s it for me. I have a big day tomorrow. I need to TRY to get to bed early.