The HomeGroup troubleshooter does not give any useful information?
Do you have a Homegroup set up on another system, since only one controls the Homegroup and others can only join it.
From you description of what happens when you try to set one up, it almost sounds like you do not have the proper sharing options configured.