At a very high level, they are both for univariate models. BaseWindows generates the entire forecast horizon in one shot, while recurrent will do it one step at a time.
For example, MLP uses BaseWindows, but LSTM uses Recurrent.
What model are you trying to implement? Maybe we can take it on our end and release it for everyone 🙂