Yes, this is the default behavior of the AutomaticUpdater. Just add it to your app and it handles that all automatically.
Does it check on *every start? No, that would be silly. It checks at the interval set in the "DaysBetweenChecks" property.
Tell me if that helps.