Today in AI: Mixture of In-Context Learners

Mixture of In-Context Learners

Uses subsets of demonstrations to train experts via in-context learning. Given a training set, a trainable weighting function is used to combine the experts' next-token predictions.

This approach applies to black-box LLMs since access to the…

Pretty cool!! Lets #connect