Accessing Test predictions in link prediction pipeline

[dg_22]

Hi,

      I was wondering if it would be at all possible to access the test predictions during the training phase of the link prediction pipeline to better understand the types of predictions the model is getting right and wrong. So I would like to be able to see the set of nodes, test prediction, and actual label (0 or 1). In the logs I can see some of the training metrics but not the actual test predictions themselves. Please let me know if this would be possible within the pipeline. Thank you 

[adam_schill-col]

Hi @dg_22,

No such information is exposed at training time at the moment unfortunately. Since most users work with large datasets it would yield a lot of noise to the logs. We could consider adding a dedicated log for just this information however. Would that suit your needs?

[dg_22]

Oh I see. Yes that would be very helpful! Thank you 

[dg_22]

About how long do you think it would take to implement something like that?

[adam_schill-col]

I can add the feature as a roadmap candidate, and then it might be included in a subsequent release of the library. We have a lot of things we want to do for upcoming releases so cannot promise we'll get to this in the near future however. It depends on how it will be prioritized internally.

[dg_22]

Oh ok, no worries. I understand. But thanks for adding it as future candidate and look forward to utilizing it once it comes out 👍