That's my rule. I go with L or 100 when I have enough light. I bump it up from there on an as-needed basis.
I'd say that generally speaking, I shoot at 100 in sunlight, 200 in light clouds, 400 in heavy clouds or bright indoor areas, 800 in moderate indoor lighting, 1600 in dim lighting, 3200 when it is dark, 6400 when I have no other choice.
Those guidelines can be misleading. If I'm shooting a f/1.4, I'm probably going to be a few stops lower in ISO that I would be when I'm shooting at f/4. If I want to shoot at f/16, I'll increase the ISO several stops. The same logic applies if I'm trying to get long shutter speeds or very fast shutter speeds.