Using Text Explorer Topic Model Formula to predict Topics for New Text

Question

I've spent some time trying to answer this for myself (even "Googled It" :) , with no success, so now turning to the experts.

I have a client who has text data and JMP Pro.  He uses his existing data (training & validation sets) to come up with a reasonable Topic analysis model to predict a nominal response.  For example, he is using the text input to predict whether a prospective customer might be a good credit risk, based on  data that has been accumulated when the customer called a company rep on the phone.

Now he has a model, using topic vectors to predict credit risk.  He now wants to input new text data into the existing model and predict credit risk for the new customer.  (Make sense?)  How do we do that?

I've tried saving the Topic Vector Formula, but that doesn't update calculate new topic scores for added text in new rows.

Can it be done this way?  Or would it be better to revert to the larger DTM's instead of topics?

Seems like this should be simple, but I'm not seeing it.

Any/all help is appreciated!

Jerry

jiancao · Answer

Clarification: Topic Vector Formula actually updates with new documents. However, the results do not match the results from Save Topic Singular Vectors. This seems to be caused by the bug that I referred to above.

jiancao · Answer

There appears to be a bug causing the formula not working in JMP Pro 14.1. The bug was fixed in JMP Pro 13.2 and JMP Pro 14, but it has reappeared in 14.1. I've reported it the Development.

Additionally, two saving options, Save Topic Singular Vectors and Save Topic Vector Formula, yield identical results with the difference being that the former produces individual columns while the latter the vector-valued format in a formula.

Daniel_Valente · Answer

Agree with @Mark_Bailey. I would use the Topic Vectors as inputs into other modeling platforms. Some modeling platforms (like Fit Model), know what to do with vector effects, others do not know what to do with them. If you want to build several models using various techniques and compare them you can use the right-click New Formula Columns -> Vector -> Columns to break out the vectors into individual columns. Then they will play nice with Neural, Partition and the like.