A nice house-rule could be: you gain xd6 each turn, where x is your CHA (min. 1). So you still enjoy rolling those d6s, AND you maintain CHA importance.
Of course, with the caveat: max 1d6 for roll.
