Nothing to be scared of.
No matter what bus stop you go to, you can catch a bus going wherever you want. All buses stop at all 7 park bus stops. In other words, if you have a room in Trinidad North, and you go to Trinidad North's bus stop, EVERY bus will eventually stop there. It's not like if you want to go to MK you need to go to a certain stop. You can simply decide to go to the nearest bus stop. ANy bus stop will do. Just use your eyes and look for the nearest one. Sometimes the nearest stop might not be in your own village ... it all depends where your room is and where the bus stops are. This is something that TRULY doesn't need to be planned in advance. It's simply a matter of eyeballing whatever's closest.
Your listing of 7 bus stops above isn't exactly accurate. There are 8 bus stops; buses that go to/from the parks DON'T stop at the Custom House. Buses to and from the parks stop at each village and at Old Port Royale.
The only bus that stops at the Custom House is the Internal Shuttle. The Internal Shuttle makes the loop to all 8 stops.
So let's say you are a bus driver dispatched to CBR to take guests to Magic Kingdom. You will enter CBR and your first stop to pick up passengers will be at Martinique. You will go clockwise around the resort, stopping at Old Port Royale, Trinidad North, Trinidad South, Jamaica, Aruba and finally Barbados before leaving CBR and going directly to MK. Buses to Downtown Disney follow the same route.
Buses to Epcot start picking up passengers at Jamaica, and go clockwise from there (Aruba, Barbados, Martinique, OPR, Trinidad North, then finally Trinidad South). Buses to Animal Kingdom and buses to Disney's Hollywood Studios follow that same route.
The fact that CBR has 7 bus stops really doesn't mean that the buses take a lot longer than buses from any other resort (some resorts share buses, so instead of multiple stops within one resort, there are multiple stops at numerous other resorts). I never timed it, but my guess is that the time difference between 60 people getting on at 1 stop and a total of 60 people getting on at 7 different stops is less than 5 minutes.
You can expect a bus for any destination to come by around every 20 minutes or so. In other words, if you walk up to the stop just as an Epcot bus is pulling away, your average wait for the next Epcot bus will be about 20 minutes. Buses are VERY clearly marked on the front as well as on each side. Unless you have a vision problem, you won't be able to mistake one bus for another ... it's not like they are color-coded or anything else that you'd have to decipher or remember. You just have to pay enough attention to NOT get on a bus marked "ANIMAL KINGDOM" if your intended destination is Disney's Hollywood Studios.
Yes, sometimes the buses do get very crowded, but often they are not. Please realize that the 2 Port Orleans resorts usually share buses, and those two resorts have a total of about 3,000 rooms.
If you have any other questions or concerns, we're here to help you.