.md File is not a specification: Using formal analysis to find requirements gaps
blog.fizzbee.ai
[4 comments hidden]
I'm not sure if this does much more than a grillme skill and then poking an agent to do the work.
[3 comments hidden]
In case you noticed, a year ago, LLMs could not reliably count the number of 'R's in strawberry. Now they all do well. Guess how? Instead of training LLMs to do this, it was easier for them to write a small python script and run that. That solved the problem once and for all.
The same thing here, instead of just using LLMs and keep grilling repeatedly, there is a higher chance of getting a workable solution quickly. The best part about formal methods here is, it is self validating. It checks in seconds, what would have taken hours or even days with LLM only flow.
[2 comments hidden]
Bpmn, tla+, event-b, P and ModP are all likely contenders to jump in popularity and mainstream swe worlds
[hidden]
Correctness-by-Construction, Models and Proofs go together!
meoleo[4 comments hidden]
jayaprabhakar[3 comments hidden]
However the technique is significantly different. Kiro's post says they use predicate logic. Whereas FizzBee uses Dynamic Logic. So, Kiro's approach cannot find many issues. Let us take the same example from the fizzbee blog. FizzBee found the issue as linked in the blog:
https://blog.fizzbee.ai/formal-analysis-in-requirements-spec...
But Kiro's approach would say, it is both consistent and complete. That is, R2 + R2b => R3 in this case.
-----
Another thing is testability. FizzBee's approach checks for testability without LLM deterministically. And it naturally produces extensive test cases, but with Kiro it doesn't. It needs more LLM use to convert them to test cases.
meoleo[2 comments hidden]
jayaprabhakar[hidden]