Sounds to me like you might be a very good candidate to consider a mirrorless interchangeable lens camera. They fit in the 'middle', between a DSLR and a P&S - bringing closer to P&S sizes and portability, and closer to DSLR performance due to the large sensors (in some cases, identical image quality as a DSLR). For some folks a mirrorless camera wouldn't be a good choice as an only camera, as DSLRs are still faster performers, but they are fantastic as second cameras for DSLR shooters looking for a lighter option to bring alongside their DSLR or instead of it, when you want to travel lighter but not lose image quality or low light ability.
Olympus and Panasonic make quite a few Micro4:3 models varying from thin touch-screen models with no viewfinders to chunky electronic viewfinder models with bigger grips. The sensors are smaller than a DSLR's sensor, but still quite a bit larger than any P&S, and will do much better in low light. Samsung makes the NX, which uses an APS-C sensor just like DSLRs - they seem to perform about as well as the Micro 4:3 across the board. Sony makes several NEX models, which also use APS-C sensors - these will perform about equally to the other mirrorless models in daylight, but will do even better in low light - the sensors in these are the same that Sony produces for Nikon in their D3100 and Sony's DSLR-A550/A33 (NEX3 and NEX5) and in the D5100/D7000/Sony A580/A55 (NEX-C3), which are about as good as it gets in high ISO performance.
All will give you excellent DSLR-like image quality and versatility, but without the size and bulk, and without the action/sports speeds that a DSLR can deliver. A wonderful alternative for a second body. I've been extremely happy with my NEX3 as a DSLR backup, and in fact just completed a 1 day Disney trip on Saturday (I was on a business trip Sun-Tues, and took the day before to hit Disney) where I only brought the NEX with me and left the DSLR kit home - it was just easier to travel light with the NEX and 3 or 4 lenses in a small bag that could slip inside my weekender bag.