First of all I would avoid using fillers, it's only gonna get worse. Try some relaxing techniques and get used to talking during exhaling(most of us don't know how to breath), your voice will be in lower tone. Personally for me the hardest part is to learn new way of speaking and unlearn the old way.