Presentation: From Thousands to One: Building LLM-Powered Selection Systems

Jendrik Jordening: I want to indeed talk about like, how can I choose with an LLM, where did this originate? We are automating procurement related tasks and that has a lot to do with like, choose the cost center that is responsible for the costs. It's like you need actually an ID in the database. When we started that it was all nice from a deep learning perspective. We needed to do something. We collected a dataset. We trained a model. It was of course easy to do a decision because we just added an argmax layer in the end and it gave me a decision. Then LLMs came and I was like, this feels somewhat like going from pandas to Excel. You can swiftly create everything, of course. It's like you can ask a model everything. It will give you an answer. It will look totally amazing. You get a UI included. You get weapons included nowadays with MCPs. You get historic knowledge, like I don't need a training dataset to know that a laptop is probably going to an IT department. That's reasonable from the descriptions. Problem is like, model, view, and controller somewhat end up in one.…