Towards re-defining relation understanding in financial domain

Abstract

We describe our experiences in participating in the scored task for the 2017 FEIII Data Challenge. Our approach is to model the problem as a binary classification problem and train an ensemble model leveraging domain features that capture financial terminology. We share challenge results for our submission, which performed well achieving the highest score in four out of six evaluation criteria. We describe semantic complexities encountered with regards to the task definition and ambiguities in the labeled dataset. We present an alternative task formulation Relationship Validation that addresses some of these semantic complexities and demonstrate how our approach naturally extends to this simplified task definition.