I like your idea and think it would be neat to have that incorporated. The problem is that the "the force" and "magic" really are, for the most part, the same thing as far as the stories are concerned. Not everyone is able to use magic in HP, much like not everyone is able to use the force in SW. However, like you said, only opening up these type of experiences to a select few causes many folks to be upset because they're not being included. Even though the experience would be more "magical or mysterious" if it wasn't open to everyone, by not allowing the entire consumer base to use it likely creates more headache than they want to deal with.
What I think would be neat would be to tie force powers to magic bands and have randomly selected individuals who are able to use the force. Not everyone would be able to use it which would have people complaining, but I think it would be more in line with the overall theme and story behind the land.