If your website is taking more than a couple of seconds to load, you will lose the majority of people coming to your site.
There are a number of free tools online that can be used to check this; here's an example.