Go to GitHub settings
You'll see this:
Automatic Watching
☑ Automatically watch repositoiries
When you’re given push access to a repository, automatically receive notifications for it.
If you uncheck or untick that box you should now have to manually watch repositories that are added by your joined organisation if they've also given you push access.
You can't set it on a per organisation level though. It's all or nothing at the moment.