It is interesting, but I don't know how to operationalize it.
Since it takes 80% of the MLB season to build the pitcher-specific profiles, it's unlikely a manager in a pennant race will be willing to switch to this tool on August 1st.
However, it is very likely any manager presented with this tool would believe he has additional relevant information (e.g., how good the pitcher's stuff is, how he is sustaining velocity, how confident he is in the pitcher's competitiveness, how his mechanics look, how the pitcher says he feels, where the pitcher is due to bat in the next inning, heat, humidity, whether his team is ahead or behind and by how much, how rested the bullpen is, etc.) that would overrule the predictive value of the model.
Hard to see anyone using it as more than one more piece of info to consider along with all the other factors a major league manager must continuously and subjectively weigh.
Real hard to see any other levels of ball having the data to employ it because of the shorter season, absence of data on opposing hitters, less consistency among pitchers.
Another impediment to deploying it is it doesn't take into account what happens after the decision to pull the starter. It's one thing to have a model that predicts more accurately whether the starter will give up a run in the next inning; it's quite another thing to predict the outcome of all the remaining innings in the game based on going to the bullpen sooner. It's like when your broker suggests it's time to sell a stock. Taking the advice forces a subsequent decision, whose consequences are unknowable.