Yeah it works, just say the word softly and nobody will even notice if you say "ifty" instead of "fifty". And over time, it might be easier to say "fifty" because you've begun speaking a bit more softly.