Should we buy train tickets to Hualien and Tainan (high speed) from Taipei in advance or they usually are available a day or two before? We will be there in first/second week of May. Thanks.

hi, i am living in Taiwan.
actually , high speed is only available in western Taiwan.
it means you can not take it from taipei to Hualien.
(buy train ticket earlier because the train tickets to eastern taiwan are always sold out in a short time. if u buy stand ticket , it is OK but almost 3 hours. )
taipei to tainan is OK, just 1.5 hr. very fast. (you dont need to book the tickets before, if the seat area tickets are sold out, u can buy stand area ticket.)
welcome to our fan page we set up few days ago , introducing Taiwan. :)
https://www.facebook.com/TaiwaneseImage
You don't have to book high-speed tickets in advance, just turn up at the station and buy tickets for the next train. Trains leave frequently, and I think they're rarely, if ever, full. To Hualian, there are both fast and slow trains (the difference is only an hour or so). The faster trains do sell out, so buying tickets a day or two in advance wouldn't be a bad idea, but even if you just turn up without a ticket you shouldn't have to wait too long for a train. Certainly no need to book more than a day or two in advance. Taipei's train station has a large selection of shops and a very decent food court should you have to kill some time there...
Thank you both very much.
It is reassuring to know we don't have to buy online before we leave. We are arriving on Sunday and planning to go to Taroko (Hualien) on Tuesday. We will buy tickets to Hualien as soon as we reach Taipei. And I don't mind slow train, I like train travel. As for Tainan, we can go any day during our 8 day stay.
Is there any price difference, if we buy in advance?

Your welcome, have great time in Tainan. I live in Kaoshiung and love to visit Taiwan, very interesting city.
