Going to chip in a bit on guns at the moment, I may put some more in later on the other topics.
Every Ontario hunter should own minimum three guns
a .22LR (long rifle) rifle. This your small game, and "fun" gun. Ammo is literally pennies, so you can shoot lots, and often. It has no recoil. You can hunt all the assortment of small game (excluding waterfowl) with it. It is a great gun for just shooting. The fundamentals of shooting can be learned and refined at low expense then applied to your large calibre rifle when hunting large game.
a 12 gauge shotgun. This is the jack of all trades of the gun world. You can hunt small game, upland birds, and waterfowl using shot (pellets) or large game with a slug (you'll learn about these in the course). I would recommend you start out with a newer made gun with interchangeable chokes, and possibly one with changeable barrels (that is secondary). Changeable barrels woul refer to installing a rifled slug barrel, which increases the effective range and accuracy of a shotgun slug. This is important in southern ON (roughly a line from Ottawa to Barrie to Windsor) where you cannot hunt deer with a rifle due to legal restrictions applied by the Ministry of Natural Resources.
Finally, your big game rifle. Pick one that you like best in one of these three calibres. 270 Winchester, 308 Winchester, or 3006 Springfield. These three calibres offer roughly the same performance, with ammunition of roughly the same price and availability. You cant hunt any animal in North America with these three. The differences between the three are pretty academic on ranges that most in Ontario shoot big game (less then 200 meters). The good thing about rifles is that they dont wear out or go outdated (with normal use). Used rifles can be had for substantially lower cost then new ones. if they have been looked after they will be more then good enough for you to hunt with.
If you do your research, and can cut a few corners, the three above can be had for under $1000 (total). I realize thats a great expense, but its the minimum I would recommend. You obviously dont need all at once, I would try and get your 22lr and 12g soon and leave your large cal rifle until you are planning a moose, bear, or deer hunt in northern Ontario.