Efficiently routing manuscripts to qualified academic editors is a common challenge in peer review cycles. Here we’ll look at how PLOS used information retrieval methodologies and algorithm classifiers to grade the performance of its own manuscript-to-editor matching solution, and then engaged the project’s audience through use of Jupyter notebooks to disseminate resulting data. Furthermore, as our goal was not only to evaluate an existing in-house implementation, but also to provide a consistent analysis framework to be used across potential solutions involving concept extraction, we'll discuss approaches to both of these aspects in this session.