Are help widgets and contextual help plugins the same thing?

No. A generic help widget may simply expose static content, while a contextual help plugin aims to adapt support to the page, task, or workflow the user is dealing with.