When a discussion forum is set up, do all members receive a notification mail?

Yes. A mail informing users about the creation of discussion forum is sent to all the members of the project.

For more information about dicussion forums see: Administer forums and mailing lists