Custom Model Selection for Merlin Magic!
under review
Samuel Jackson
Merlin Magic is a great feature, automatically selecting the best model for a given task. However, since it picks from all available models, it sometimes defaults to weaker ones that struggle with more complex requests.
I understand that this would go against the core idea of Merlin Magic, which is meant to choose the best model dynamically. However, there are times when I have a complex request but don’t know which model to use, and Merlin Magic ends up selecting a smaller or outdated model that simply can’t handle the task.
Would it be possible to let users create a custom selection of models that Merlin Magic can choose from? For example, allowing it to pick only from o1-mini, o1-preview, o1, and o3-mini-high (or any preferred set). This would give users more control and ensure that responses always meet their expectations!
endu
under review
endu
Merged in a post:
Custom Model Selection for Merlin Magic!
Samuel Jackson
Merlin Magic is a great feature, automatically selecting the best model for a given task. However, since it picks from all available models, it sometimes defaults to weaker ones that struggle with more complex requests.
I understand that this would go against the core idea of Merlin Magic, which is meant to choose the best model dynamically. However, there are times when I have a complex request but don’t know which model to use, and Merlin Magic ends up selecting a smaller or outdated model that simply can’t handle the task.
Would it be possible to let users create a custom selection of models that Merlin Magic can choose from? For example, allowing it to pick only from o1-mini, o1-preview, o1, and o3-mini-high (or any preferred set). This would give users more control and ensure that responses always meet their expectations!
endu
Hi Samuel Jackson Got your point, but why not turn off Magic and manually choose the models yourself? That way, you have full control. Also, curious—what other aspects, apart from model selection, would you like Magic to handle while still giving you the flexibility to choose models? 😊
Samuel Jackson
endu I completely understand what you are saying, but my point is that sometimes, for certain requests, I don’t know, for example, which reasoner model is the best suited. Selecting Merlin Magic could resolve this issue, but it might happen that Merlin Magic chooses a non-reasoner model, which could lead to the request being completed incorrectly.
Apart from model selection, I also like that Magic can automatically decide whether to search the web. However, in my experience, it’s not very smart about this because sometimes it searches the web even when it’s not necessary for the request.
I hope I’ve made my point clear now, and thank you for reaching out to me!"
endu
Samuel Jackson: ahhh, okay, Got it—this can definitely be improved. We’ll work on enhancing its decision-making and look into adding a user input level where you can check which model is being chosen and give the go-ahead before the query is executed. Thanks for sharing your thoughts! 😊
Samuel Jackson
endu thank you!