I think you've got that backwards... HST/PST/GST is definitely factored in for imported goods... it even says so on the CBSA website:
"Most imported goods are also subject to the Federal Goods and Services Tax (GST) and Provincial Sales Tax (PST) or, in certain provinces and territories, the Harmonized Sales Tax (HST)."
CBSA will also add tariffs/duties if applicable. Based on the info you provided above, I tried out the estimater tool they have and this is what it came back with:
View attachment 628230
Notice there was no Duty charged but you do have to pay the HST in ON. I estimated the $2000 USD was $2500 CAD for game tokens made in North America. The $290 you paid is pretty close to the estimate above and would depend on the exchange rate at the time.