I agree with pumba, I let my peppers stay on the plant until I'm ready to use them. Peppers just like any other fresh garden vegetable losses it flavor the longer it hangs around the kitchen.
I realize you only have 3 plants which should not be a problem with too many vegetables.
I have a regiment where I pick the ripened crop each morning and use the crop for dinner. Sometimes this can be a problem with 12 zucchini and 12 summer squash plants. So it's squash every night for me, my children and the neighbors.
We basically live off the garden once it starts producing.