Hello I am trying Nixtla for the first time and I am confused on how to use it? Do I need an API key?

Yes, if you want to use this beta idea. No, if you want to use the open source libraries. I will DM you to get more info on your use case.