Tips on how to augmenting embeddings?

[JosephGatto]

I am struggling to understand how to update the evaluation codes to enable the use of an augmented embedding. I feel like I understand what to do re: overriding the encode function, but after that it gets tricky with different types of evaluations. In other words, I see how I can update the embedding returned from encode to include additional information, but it becomes unclear how that embedding gets used in different evaluations.

What I am looking for is tips on how to, for example:

• for STSB, get cosine_sim((BERT Embedding 1, Additional Embedding 1) ,(BERT Embedding 2, Additional Embedding 2))
• for RTE, get classifier((BERT Embedding, Additional Embedding))

Specific instruction where to look for these two tasks may enlighten me on how to do this generally.

Thanks!